Changes between Version 1 and Version 2 of administration/search

Timestamp:

Apr 12, 2009, 3:59:58 PM (14 years ago)

Author:

hank

Comment:

work on nutch

administration/search

@@ -2 +2 @@
 is set to /usr/wwwapps/crawldir
 
-http://today.java.net/pub/a/today/2006/01/10/introduction-to-nutch-1.html[[BR]]
+http://today.java.net/pub/a/today/2006/01/10/introduction-to-nutch-1.html
+
 http://today.java.net/pub/a/today/2006/02/16/introduction-to-nutch-2.html
 
@@ -23 +24 @@
 create files[[BR]]
 add file:///FILES/
+
+
+
+New Nutch:
+wget http://nutch
+
+edit regex-urlfilter.txt [post here]
+
+edit crawl-urlfilter.txt [post here]
+
+edit nutch-site.xml [post here]
+
+download pdf libraries
+{{{
+cd src/plugin/parse-pdf/lib
+wget http://pdfbox.cvs.sourceforge.net/viewvc/*checkout*/pdfbox/pdfbox/external/jai_codec.jar
+wget http://pdfbox.cvs.sourceforge.net/viewvc/*checkout*/pdfbox/pdfbox/external/jai_core.jar
+}}}
+In src/plugin/parse-pdf/plugin.xml
+{{{
+<!-- Uncomment the following two lines after you have downloaded the
+     libraries, see README.txt for more details.-->
+<library name="jai_codec.jar"/>
+<library name="jai_core.jar"/>
+}}}
+
+Rebuild Nutch:
+{{{
+cd ..nutch-1.0/
+ant jar
+ant compile-plugins
+ant war
+}}}