javascript - How can I efficiently move from a Pandas dataframe to JSON -


i've started using pandas aggregation date. goal count of instances of measurement occur on particular day, , represent in d3. illustrate workflow, have queryset (from django) looks this:

queryset = [{'created':"05-16-13", 'counter':1, 'id':13}, {'created':"05-16-13", 'counter':1, 'id':34}, {'created':"05-17-13", 'counter':1, 'id':12}, {'created':"05-16-13", 'counter':1, 'id':7}, {'created':"05-18-13", 'counter':1, 'id':6}]

i make dataframe in pandas , aggregate measure 'counter' day created:

import pandas pd queryset_df = pd.dataframe.from_records(queryset).set_index('id') aggregated_df = queryset_df.groupby('created').sum()

this gives me dataframe this:

          counter created           05-16-13        3 05-17-13        1 05-18-13        1

as i'm using d3 thought json object useful. using pandas to_json() function convert dataframe this:

aggregated_df.to_json()

giving me following json object

{"counter":{"05-16-13":3,"05-17-13":1,"05-18-13":1}}

this not want, able access both date, , measurement. there way can export data such end this?

data = {"c1":{"date":"05-16-13", "counter":3},"c2":{"date":"05-17-13", "counter":1}, "c3":{"date":"05-18-13", "counter":1}}

i thought if structure differently on python side, reduce amount of data formatting need on js side planned load data doing this:

  x.domain(d3.extent(data, function(d) { return d.date; }));   y.domain(d3.extent(data, function(d) { return d.counter; }));

i'm open suggestions of better workflows overall need unsure of best way of handling connection between d3 , pandas. (i have looked @ several packages combine both python , d3 directly, not looking seem focus on static chart generation , not making svg)

transform date index simple data column reset_index, , generate json object using orient='index' property:

in [11]: aggregated_df.reset_index().to_json(orient='index') out[11]: '{"0":{"created":"05-16-13","counter":3},"1":{"created":"05-17-13","counter":1},"2":{"created":"05-18-13","counter":1}}'

Comments

Post a Comment

Popular posts from this blog

java.util.scanner - How to read and add only numbers to array from a text file -

i'm learning java , have question regarding reading file want read numbers file contains strings well. here example of file: 66.56 "3 java 3-43 5-42 2.1 1 and here coding: public class test { public static void main (string [] args){ if (0 < args.length) { file x = new file(args[0]); try{ scanner in = new scanner( new fileinputstream(x)); arraylist<double> test = new arraylist<>(); while(in.hasnext()){ if(in.hasnextdouble()){ double f=in.nextdouble(); test.add(f);} else {in.next();} } catch(ioexception e) { system.err.println("exception during reading: " + e); } } my problem add 66.56,2.1 , 1 doesn't add 3 after "3 or ignores 3-43 , 5-42 can tell me how skip strings , add doubles here? thanks all said 3 ie; "3, 3-43 , 4-42 strings either u read string , split , check number @ " , - or put in space between characters , integers. jvm after compilation tre...
Read more

rewrite - Trouble with Wordpress multiple custom querystrings -

i'm working on adding multiple querystring , doesn't seem work. i've found codes seems work others might i'm missing something. i want like: http://mydomain.com/board/?getyear=2013&getsometext2=sometext to http://mydomain.com/board/2013/sometext/ i added code below functions.php file. doesn't seem work should though. this works. echoing querystring gets both variable without problem. http://mydomain.com/board/2013/sometext/ but doesn't. tested querystring vis isset() seems nothing being set/get http://mydomain.com/board/2013/ function add_query_vars($vars) { $vars[] = "getyear"; $vars[] = "getsometext2"; return $vars; } add_filter('query_vars', 'add_query_vars'); function add_rewrite_rules($arules) { $anewrules = array('board/([^/]+)/([^/]+)/?$' => 'index.php?pagename=board&getyear=$matches[1]&getsometext2=$matches[2]'); $arules = $a...
Read more