java - Getting ClassCastException while developing UDTF in Hive -


i getting issue classcastexception while developing udtf in hive.

here details :

  1. i trying implement loop kind of functionality can pass 3 parameters for_each(start,stop,increment).
  2. if pass parameters values for_each(1 , 10 , 1) works fine.
  3. whereas, stop value parameter trying pass result of 1 of udf function (eg. stopvlaue() value for_each(1 , stopvalue() , 1). stopo dovalue() function returns me intwritable. when try getting below exception : "classcastexception org.apache.hadoop.hive.serde2.objectinspector.primitive.writableintobjectinspector cannot cast org.apache.hadoop.hive.serde2.objectinspector.primitive.writableconstantintobjectinspector"

here udtf:

public class generateseries extends genericudtf {     intwritable start;     intwritable end;     intwritable inc;     object[] forwardobj = null;        @override     public structobjectinspector initialize(objectinspector[] args) throws udfargumentexception      {          start=((writableconstantintobjectinspector) args[0]).getwritableconstantvalue();         end=((writableconstantintobjectinspector) args[1]).getwritableconstantvalue();         if (args.length == 3)          {             inc =((writableconstantintobjectinspector) args[2]).getwritableconstantvalue();         } else {             inc = new intwritable(1);         }         this.forwardobj = new object[1];         arraylist<string> fieldnames = new arraylist<string>();         arraylist<objectinspector> fieldois = new arraylist<objectinspector>();         fieldnames.add("col0");         fieldois.add(primitiveobjectinspectorfactory.getprimitivejavaobjectinspector(primitivecategory.int));         return objectinspectorfactory.getstandardstructobjectinspector(fieldnames, fieldois);     }     @override     public void process(object[] args) throws hiveexception, udfargumentexception      {         (int = start.get(); < end.get(); = + inc.get())          {             this.forwardobj[0] = new integer(i);             forward(forwardobj);         }     }      @override     public void close() throws hiveexception {         // todo auto-generated method stub      } }

any idea how can resolve issue?

thanks in advance

the initialize method, in cases, not give actual value of input function, can different different rows. tells types of input. actual values can consistently accessed process method. you're taking advantage of 1 notable exception, constants. general pattern should follow instead is:

  1. store input inspectors in instances variables in initialize method. can check types expect, won't writableconstantintobjectinspector. should subclasses of primitiveobjectinspector , if call getprimitivecategory method, should primtivecategory.int.
  2. use stored input inspectors retrieve data in objects passed in process method. example, integer n = (integer)inspector.getprimitivejavaobject(args[0])

Comments

Post a Comment

Popular posts from this blog

c++ - CryptStringToBinary API behavior -

i seeing strange behavior cryptstringtobinary cryptography api. please see below code (config: x64 debug): #include "stdafx.h" #include <windows.h> #include <strsafe.h> #include <iostream> #include <exception> void main() { dword dwskip; dword dwflags; dword dwdatalen; //lpcwstr pszinput = l"jaaaaaecaaadzgaaakqaagdnnl1l56bwgfjdgr3rpxtqqqn6daw3usv2emkjym4t"; //this works fine lpcwstr pszinput = l"mytest"; //doesnt work, api returns false,error code 0x0000000d // determine size of byte array , allocate memory. if(! cryptstringtobinary( pszinput, _tcslen( pszinput ) + 1, crypt_string_base64, null, &dwdatalen, &dwskip, &dwflags ) ) { dword dw = getlasterror(); //0x0000000d: data invalid throw std::exception( "error computing byte length." ); } byte *pbytebyte = null; try { ...
Read more

java.util.scanner - How to read and add only numbers to array from a text file -

i'm learning java , have question regarding reading file want read numbers file contains strings well. here example of file: 66.56 "3 java 3-43 5-42 2.1 1 and here coding: public class test { public static void main (string [] args){ if (0 < args.length) { file x = new file(args[0]); try{ scanner in = new scanner( new fileinputstream(x)); arraylist<double> test = new arraylist<>(); while(in.hasnext()){ if(in.hasnextdouble()){ double f=in.nextdouble(); test.add(f);} else {in.next();} } catch(ioexception e) { system.err.println("exception during reading: " + e); } } my problem add 66.56,2.1 , 1 doesn't add 3 after "3 or ignores 3-43 , 5-42 can tell me how skip strings , add doubles here? thanks all said 3 ie; "3, 3-43 , 4-42 strings either u read string , split , check number @ " , - or put in space between characters , integers. jvm after compilation tre...
Read more

iphone - Three second countdown in cocos2d -

i trying have 3 second countdown display when level beat in game. did: -(void) gamesegmentbeat { [self pauseschedulerandactions]; // overlay game opaque background ccsprite *opaquebg = [ccsprite spritewithfile:@"background1.png"]; opaquebg.position = screencenter; [self addchild:opaquebg z:10000]; // these 3 labels 3 seconds cclabelttf *three = [cclabelttf labelwithstring:@"3" fontname:@"helvetica" fontsize:100]; three.position = ccp(screencenter.x, screencenter.y); cclabelttf *two = [cclabelttf labelwithstring:@"2" fontname:@"helvetica" fontsize:100]; two.position = ccp(screencenter.x, screencenter.y); cclabelttf *one = [cclabelttf labelwithstring:@"1" fontname:@"helvetica" fontsize:100]; one.position = ccp(screencenter.x, screencenter.y); // secondspast specified in update method secondspast = 0; if (secondspast == 1) { [self addchild:thr...
Read more