2014-01-16 19:46
Setting Up Tika's Extracting Request HandlerSome of this is covered in the set-up of SolrSometimes indexing prepared text files (such as XML, CSV, JSON, etc) is not enough. There are numerou… Read More
Blog Directory > Blogging Blogs > Share What You Know, Learn What You Don't blogging Blog >
Share What You Know, Learn What You Don't Blog
amac4.blogspot.co.uk
Tags:
pig udf
solr
context throws ioexception
column family
tika
lueders amp allan
args throws exception
bytes
indexing
composite key
A blog to help those tech geeks with the same problems I have had.
amac4 - Allan Macmillan - blog - blogspot
amac4.blogspot.com
2014-01-07 02:01
Hive UDF - Convert Date to Unix TimestampBackgroundThis little UDF will convert a date, in any specified format, into a unix timestamp. To specify the date just edit the string in the… Read More
2014-01-07 01:56
Pig UDF ExampleBackgroundThis little UDF will convert the first 8 bytes of an HBase key into a long. The Key that we had was a composite key made up of two 8 Byte longs and we needed t… Read More
2014-01-07 01:48
Pig UDF - Converting HBase Key to LongBackgroundThis little UDF will convert the first 8 bytes of an HBase key into a long. The Key that we had was a composite key made up of two 8 Byt… Read More
2013-12-22 23:22
Adding/Delete a Column Family (HBase)private static Configuration conf;//Choose conf settingsHBaseAdmin hAdmin = new HBaseAdmin(conf);hAdmin.disableTable("[TABLE]"); //MUST DISABLE FIRST//De… Read More
2013-12-22 23:17
MapReduce Combiner Example (HBase)The combiner is a reduce type function that takes place during the map operation. This allows for local data reduction while the map output is still in memo… Read More
2013-12-22 23:17
Retrieving Composite Key (HBase)Its common to want to have the key of your HBase table to be made up more than one component, especially to ensure that your key stays unique. There is… Read More
2013-12-14 16:12
Creating an Index Structure for MapReduce over HDFS (Hadoop 2.0.0)Some tips and advice from experience designing an Index structure for MapReduce running over HDFS.ClusterThe MapRe… Read More
2013-08-27 14:54
PreparationYou should have set-up Solr on Tomcat along with Tika's extracting request handler as shown in the previous two guides: http://amac4.blogspot.co.uk/2013/07/setting-up… Read More
2013-08-16 13:40
So I came across the dreaded /windows/system32/config/system file is misssing or corrupt recently and I didn't have my XP disk to hand. No matter which Forum I went to or blog post I r… Read More
2013-08-16 10:30
Nutch allows you to crawl the web or a filesystem in order to build up index store of all its content. If your objective is to simply crawl the content once, it is fairly easy. But if you wa… Read More
2013-08-15 15:09
Setting Up DeduplicationI followed the Solr wiki to try and set-up deduplication and all it did was cause my Solr server to break, these settings worked for me and should also work for you t… Read More
2013-08-15 15:04
Nutch allows you to crawl the web or a filesystem in order to build up index store of all its content. If your objective is to simply crawl the content once, it is fairly easy. But if you wa… Read More
2013-08-15 14:59
It is common to apply an XSLT stylesheet to an xml file to give it a cleaner look and Solr is no different coming with 4 pre-written xslt files for you to choose from. The error messag… Read More
2013-08-15 10:42
Expecting Nutch to be flying through all the websites you want it to crawl but in reality it is sequentially, one by one going through each page. Well you have not configured Nutch to use mu… Read More
2013-08-14 08:22
Error parsing: xxx failed(2,0): Unable to read 512 bytes from 65536 in stream of length 65421. The error that you are receiving is because of length of the file so for each error messa… Read More
2013-08-14 08:21
If you’re having trouble installing MySQL on Windows 7 (Any other platform will probably be the same) then I’d recommend the following process. Don’t skip the first s… Read More
2013-08-13 14:51
The large search engines like Google and Bing show you a small snippet of text that often contains one or more of the keywords that have been searched for. To set this up on Solr is also ver… Read More
2013-07-26 19:54
The XSLT files that Solr has standard are pretty good and cover a wide variety of different transforms however they didnt give me exactly what I wanted. I use Nutch as a filesystem cra… Read More
2013-07-26 13:53
This is a multi-threaded java program that takes a filepath and recursively goes through each folder and displays the contents of each package FileName;import java.util.*;import ja… Read More
2006-06-07 11:16
Dreamweaver & Subversion IntegrationTo set up Subversion with Dreamweaver CS6 (Should work with older versions too).Click on Manage Sites then New SiteChoose a Site N… Read More
2006-06-07 11:16
Testing Whether a String/Piece of Text is EnglishBeing able to tell whether a piece of text looks like a valid string has many applications especially in the cryptography field when trying t… Read More
2006-06-07 11:16
Setting Up Tika's Extracting Request HandlerSome of this is covered in the set-up of SolrSometimes indexing prepared text files (such as XML, CSV, JSON, etc) is not enough. There are numerou… Read More
2006-06-07 11:16
Pig Example - Loading Data From HBaseBackgroundThis is just a simple pig script that use HBase as its data source. Column1 - timestamp - longColumn2 - composite numbers - bytearray… Read More
2006-06-07 11:16
Pig Example - Loading From txt File on HDFSBackgroundThis is just a simple pig script that runs using a .txt file as its data source. The text file that is being loaded is a space … Read More
2006-06-07 11:16
Hive Example - Loading From .txt File on HDFSBackgroundThis is just a simple hive script that runs using a .txt file as its data source stored on HDFS. The text file that is being loade… Read More
Subscribe to Share What You Know, Learn What You Don't
Get updates delivered right to your inbox!