dictionary - Pig Convert tuple data to map? -


hello can guide on conversion of tuple data map using pig?

i have data 

2013-09-24 19:58:04.440 server120 trsid=20,rid=e7a8-244ce04-03b6k8962890k,extid=e7a8a921-244c-e043-03b6k8962890k

i tried convert data map below. how not able convert data map, resulting in tupletomapfailed error.

package mymapudf; import java.io.ioexception; import org.apache.pig.evalfunc;  import java.util.map; import java.util.map.entry;  import org.apache.pig.data.tuple;  public class udfmap extends evalfunc<map> {     public map exec(tuple input) throws ioexception      {         try          {            //tabag values = (databag)input.get(1);            //string value = (string)input.get(1);            //map<object, object> m = new hashmap<object, object>();            map<string,string> m2 = (map<string, string>) input.get(1);            (entry<string, string> entry:m2.entryset())             {                m2.put(entry.getkey(),entry.getvalue());                //tuple tuple = tuplefactory.newtuple(2);            }            return m2;        }         catch(exception e)         {             throw new runtimeexception("tupletomapfailed error", e);        }     } }

please provide suggestions on achieving needed map conversion remaining data leaving timestamp ?

schema: 

data_load = load '/user/uk01/test.log'  using pigstorage(' ') ( dt:chararray, nodes:tuple(servername:chararray,tris:chararray,extid:chararray));  gen_test = foreach data_load generate mymapudf.udf(nodes);

pig stack trace:

error 2999: unexpected internal error. tupletomapfailed error  java.lang.runtimeexception: tupletomapfailed error         @ mymapudf.udfmap.exec(udfmap.java:30)         @ mymapudf.udfmap.exec(udfmap.java:1)         @ org.apache.pig.backend.hadoop.executionengine.physicallayer.expressionoperators.pouserfunc.getnext(pouserfunc.java:337)         @ org.apache.pig.backend.hadoop.executionengine.physicallayer.expressionoperators.pouserfunc.getnext(pouserfunc.java:428)         @ org.apache.pig.backend.hadoop.executionengine.physicallayer.physicaloperator.getnext(physicaloperator.java:352)         @ org.apache.pig.backend.hadoop.executionengine.physicallayer.relationaloperators.poforeach.processplan(poforeach.java:372)         @ org.apache.pig.backend.hadoop.executionengine.physicallayer.relationaloperators.poforeach.getnext(poforeach.java:297)         @ org.apache.pig.backend.hadoop.executionengine.physicallayer.physicaloperator.processinput(physicaloperator.java:308)         @ org.apache.pig.backend.hadoop.executionengine.physicallayer.relationaloperators.pofilter.getnext(pofilter.java:95)


Comments

Post a Comment

Popular posts from this blog

java.util.scanner - How to read and add only numbers to array from a text file -

i'm learning java , have question regarding reading file want read numbers file contains strings well. here example of file: 66.56 "3 java 3-43 5-42 2.1 1 and here coding: public class test { public static void main (string [] args){ if (0 < args.length) { file x = new file(args[0]); try{ scanner in = new scanner( new fileinputstream(x)); arraylist<double> test = new arraylist<>(); while(in.hasnext()){ if(in.hasnextdouble()){ double f=in.nextdouble(); test.add(f);} else {in.next();} } catch(ioexception e) { system.err.println("exception during reading: " + e); } } my problem add 66.56,2.1 , 1 doesn't add 3 after "3 or ignores 3-43 , 5-42 can tell me how skip strings , add doubles here? thanks all said 3 ie; "3, 3-43 , 4-42 strings either u read string , split , check number @ " , - or put in space between characters , integers. jvm after compilation tre...
Read more

rewrite - Trouble with Wordpress multiple custom querystrings -

i'm working on adding multiple querystring , doesn't seem work. i've found codes seems work others might i'm missing something. i want like: http://mydomain.com/board/?getyear=2013&getsometext2=sometext to http://mydomain.com/board/2013/sometext/ i added code below functions.php file. doesn't seem work should though. this works. echoing querystring gets both variable without problem. http://mydomain.com/board/2013/sometext/ but doesn't. tested querystring vis isset() seems nothing being set/get http://mydomain.com/board/2013/ function add_query_vars($vars) { $vars[] = "getyear"; $vars[] = "getsometext2"; return $vars; } add_filter('query_vars', 'add_query_vars'); function add_rewrite_rules($arules) { $anewrules = array('board/([^/]+)/([^/]+)/?$' => 'index.php?pagename=board&getyear=$matches[1]&getsometext2=$matches[2]'); $arules = $a...
Read more