Apache Solr Language Identifier

Apache Solr Language Identifier

This module is intended to be used while indexing documents. It is implemented as an UpdateProcessor to be placed in an UpdateChain. Its purpose is to identify language from documents and tag the document with language code.

Compile dependencies (102)

Group / Artifact Version Newer Version
org.apache.james » apache-mime4j-dom 0.7.2 0.8.4
org.apache.james » apache-mime4j-core 0.7.2 0.8.4
com.adobe.xmp » xmpcore 5.1.2 6.1.11
com.tdunning » t-digest 3.0 3.3
commons-fileupload » commons-fileupload 1.2.1 1.4
org.gagravarr » vorbis-java-tika 0.6 0.8
net.sourceforge.jmatio » jmatio 1.0 NA
commons-collections » commons-collections 3.2.1 3.2.2
org.apache.zookeeper » zookeeper 3.4.6 3.6.3
org.gagravarr » vorbis-java-core 0.6 0.8
org.codehaus.woodstox » stax2-api 3.1.4 4.2.1
com.spatial4j » spatial4j 0.4.1 0.5
org.ccil.cowan.tagsoup » tagsoup 1.2.1 NA
org.apache.tika » tika-java7 1.7 1.27
com.google.protobuf » protobuf-java 2.5.0 3.25.3
org.apache.tika » tika-core 1.7 1.27
jdom » jdom 1.0 1.1
org.apache.tika » tika-parsers 1.7 1.27
org.apache.tika » tika-xmp 1.7 1.27
org.apache.poi » poi-ooxml-schemas 3.11 4.1.2
org.apache.poi » poi-ooxml 3.11 5.0.0
org.restlet.jee » org.restlet.ext.servlet 2.1.1 NA
org.apache.poi » poi 3.11 5.0.0
org.codehaus.woodstox » woodstox-core-asl 4.4.1 NA
org.apache.poi » poi-scratchpad 3.11 5.0.0
org.restlet.jee » org.restlet 2.1.1 NA
rome » rome 1.0 NA
com.drewnoakes » metadata-extractor 2.6.2 2.16.0
org.tukaani » xz 1.5 1.9
com.pff » java-libpst 0.8.1 0.9.3
com.cybozu.labs » langdetect 1.1-20120112 NA
joda-time » joda-time 2.2 2.12.7
com.google.guava » guava 14.0.1 33.0.0-jre
org.antlr » antlr-runtime 3.5 3.5.2
org.ow2.asm » asm-commons 4.1 9.2
org.ow2.asm » asm 4.1 9.2
commons-configuration » commons-configuration 1.6 1.10
com.googlecode.concurrentlinkedhashmap » concurrentlinkedhashmap-lru 1.2 1.4.2
org.apache.pdfbox » jempbox 1.8.8 1.8.16
org.htrace » htrace-core 3.0.4 NA
commons-lang » commons-lang 2.6 NA
org.apache.pdfbox » fontbox 1.8.8 3.0.0-alpha2
org.noggit » noggit 0.6 0.8
org.apache.pdfbox » pdfbox 1.8.8 3.0.0-alpha2
com.ibm.icu » icu4j 54.1 73.1
org.apache.httpcomponents » httpmime 4.3.1 4.5.12
org.apache.httpcomponents » httpclient 4.3.1 4.5.11
org.apache.xmlbeans » xmlbeans 2.6.0 5.0.1
org.apache.hadoop » hadoop-annotations 2.6.0 3.3.1
commons-io » commons-io 2.4 2.11.0
org.apache.hadoop » hadoop-auth 2.6.0 3.3.1
org.apache.commons » commons-compress 1.8.1 1.21
net.arnx » jsonic 1.2.7 1.3.10
com.carrotsearch » hppc 0.5.2 0.9.0
commons-codec » commons-codec 1.10 1.15
log4j » log4j 1.2.17 NA
org.bouncycastle » bcprov-jdk15 1.45 1.46
org.bouncycastle » bcmail-jdk15 1.45 1.46
de.l3s.boilerpipe » boilerpipe 1.1.0 NA
org.apache.hadoop » hadoop-common 2.6.0 3.3.1
org.apache.hadoop » hadoop-hdfs 2.6.0 3.3.1
org.apache.solr » solr-core 5.1.0 9.6.0
commons-cli » commons-cli 1.2 1.4
org.slf4j » slf4j-api 1.7.7 2.0.12
org.apache.solr » solr-solrj 5.1.0 9.6.0
org.apache.lucene » lucene-spatial 5.1.0 7.7.3
org.apache.lucene » lucene-suggest 5.1.0 9.9.1
org.slf4j » slf4j-log4j12 1.7.7 2.0.12
org.apache.lucene » lucene-queries 5.1.0 9.9.1
org.apache.lucene » lucene-queryparser 5.1.0 9.9.1
org.aspectj » aspectjrt 1.8.0 1.9.21.2
org.slf4j » jul-to-slf4j 1.7.7 2.0.12
org.eclipse.jetty » jetty-io 8.1.10.v20130312 9.4.44.v20210927
dom4j » dom4j 1.6.1 1.4-dev-8
org.eclipse.jetty » jetty-http 8.1.10.v20130312 10.0.6
org.apache.lucene » lucene-codecs 5.1.0 9.9.1
org.eclipse.jetty » jetty-continuation 8.1.10.v20130312 9.4.44.v20210927
org.apache.lucene » lucene-core 5.1.0 9.9.1
org.apache.lucene » lucene-backward-codecs 5.1.0 9.9.1
org.eclipse.jetty » jetty-util 8.1.10.v20130312 9.4.44.v20210927
org.eclipse.jetty » jetty-jmx 8.1.10.v20130312 9.4.44.v20210927
org.apache.lucene » lucene-highlighter 5.1.0 9.9.1
org.apache.lucene » lucene-join 5.1.0 9.9.1
org.eclipse.jetty » jetty-xml 8.1.10.v20130312 9.4.44.v20210927
org.apache.lucene » lucene-memory 5.1.0 9.9.1
org.apache.lucene » lucene-misc 5.1.0 9.9.1
org.eclipse.jetty » jetty-server 8.1.10.v20130312 9.4.44.v20210927
org.apache.lucene » lucene-expressions 5.1.0 9.9.1
org.eclipse.jetty.orbit » javax.servlet 3.0.0.v201112011016 NA
org.eclipse.jetty » jetty-security 8.1.10.v20130312 9.4.44.v20210927
org.apache.lucene » lucene-grouping 5.1.0 9.9.1
org.eclipse.jetty » jetty-servlet 8.1.10.v20130312 10.0.12
com.googlecode.juniversalchardet » juniversalchardet 1.0.3 NA
org.apache.httpcomponents » httpcore 4.3 4.4.15
xerces » xercesImpl 2.9.1 RELEASE
org.eclipse.jetty » jetty-webapp 8.1.10.v20130312 9.4.44.v20210927
org.eclipse.jetty » jetty-deploy 8.1.10.v20130312 10.0.6
com.googlecode.mp4parser » isoparser 1.0.2 1.1.22
org.eclipse.jetty » jetty-rewrite 8.1.10.v20130312 10.0.11
org.apache.lucene » lucene-analyzers-phonetic 5.1.0 8.10.1
org.apache.lucene » lucene-analyzers-common 5.1.0 8.10.1
org.apache.lucene » lucene-analyzers-kuromoji 5.1.0 8.10.1

Test dependencies (5)

Group / Artifact Version Newer Version
junit » junit 4.10 4.13.2
org.apache.solr » solr-test-framework 5.1.0 9.6.0
org.slf4j » jcl-over-slf4j 1.7.7 2.0.12
org.apache.lucene » lucene-test-framework 5.1.0 9.9.1
com.carrotsearch.randomizedtesting » randomizedtesting-runner 2.1.12 2.7.8