python - Celery task in Flask for uploading and resizing images and storing it to Amazon S3 -


i'm trying create celery task uploading , resizing image before storing amazon s3. doesn't work expected. without task working fine. code far:

stacktrace

traceback (most recent call last):   file "../myve/lib/python2.7/site-packages/kombu/messaging.py", line 579, in _receive_callback     decoded = none if on_m else message.decode()   file "../myve/lib/python2.7/site-packages/kombu/transport/base.py", line 147, in decode     self.content_encoding, accept=self.accept)   file "../myve/lib/python2.7/site-packages/kombu/serialization.py", line 187, in decode     return decode(data)   file "../myve/lib/python2.7/site-packages/kombu/serialization.py", line 74, in pickle_loads     return load(bytesio(s))   file "../myve/lib/python2.7/site-packages/werkzeug/datastructures.py", line 2595, in __getattr__     return getattr(self.stream, name)   file "../myve/lib/python2.7/site-packages/werkzeug/datastructures.py", line 2595, in __getattr__     return getattr(self.stream, name)     ... runtimeerror: maximum recursion depth exceeded while calling python object

views.py

from pil import image  flask import blueprint, redirect, render_template, request, url_for  myapplication.forms import uploadform myapplication.tasks import upload_task   main = blueprint('main', __name__)  @main.route('/upload', methods=['get', 'post']) def upload():     form = uploadform()     if form.validate_on_submit():         upload_task.delay(form.title.data, form.description.data,                           image.open(request.files['image']))         return redirect(url_for('main.index'))     return render_template('upload.html', form=form)

tasks.py

from stringio import stringio  flask import current_app  myapplication.extensions import celery, db myapplication.helpers import resize, s3_upload myapplication.models import myobject   @celery.task(name='tasks.upload_task') def upload_task(title, description, source):     stream = stringio()     target = resize(source, current_app.config['size'])     target.save(stream, 'jpeg', quality=95)     stream.seek(0)     obj = myobject(title=title, description=description, url=s3_upload(stream))     db.session.add(obj)     db.session.commit()

thank you

it looks attempting pass entire uploaded file part of celery message. imagine causing trouble. recommend seeing if can save file web server part of view, have message (the "delay" argument) contain filename rather entire file's data. task can read file in hard drive, upload s3, delete locally.


Comments

Post a Comment

Popular posts from this blog

c++ - CryptStringToBinary API behavior -

i seeing strange behavior cryptstringtobinary cryptography api. please see below code (config: x64 debug): #include "stdafx.h" #include <windows.h> #include <strsafe.h> #include <iostream> #include <exception> void main() { dword dwskip; dword dwflags; dword dwdatalen; //lpcwstr pszinput = l"jaaaaaecaaadzgaaakqaagdnnl1l56bwgfjdgr3rpxtqqqn6daw3usv2emkjym4t"; //this works fine lpcwstr pszinput = l"mytest"; //doesnt work, api returns false,error code 0x0000000d // determine size of byte array , allocate memory. if(! cryptstringtobinary( pszinput, _tcslen( pszinput ) + 1, crypt_string_base64, null, &dwdatalen, &dwskip, &dwflags ) ) { dword dw = getlasterror(); //0x0000000d: data invalid throw std::exception( "error computing byte length." ); } byte *pbytebyte = null; try { ...
Read more

c++ - Correct method for redrawing a layered window -

i have window created ws_ex_layered window style. drawing onto memory bitmap using gdi+, , using updatelayeredwindow update graphical content of layered window. intend use window main window of application, require redraw frequently. seeing layered windows not receive wm_paint windows message [?] , need come appropriate method re-drawing window. optimisation not essential , it's nice have cake , eat too. therefore, in search of "correct" method use. here thoughts far: i guess it's idea render onto off-screen bitmap before bitblt ing or similar. 60 frames rendered per second should (more than?) enough (but how compare other applications' frame rates?). possible solutions: use settimer send wm_timer message on regular basis. useful because through specifying time-out value, can achieve desired frames per second, without requirement measure duration "frame" takes rendered. would cause input or other lags due frequency , speed of m...
Read more

java.util.scanner - How to read and add only numbers to array from a text file -

i'm learning java , have question regarding reading file want read numbers file contains strings well. here example of file: 66.56 "3 java 3-43 5-42 2.1 1 and here coding: public class test { public static void main (string [] args){ if (0 < args.length) { file x = new file(args[0]); try{ scanner in = new scanner( new fileinputstream(x)); arraylist<double> test = new arraylist<>(); while(in.hasnext()){ if(in.hasnextdouble()){ double f=in.nextdouble(); test.add(f);} else {in.next();} } catch(ioexception e) { system.err.println("exception during reading: " + e); } } my problem add 66.56,2.1 , 1 doesn't add 3 after "3 or ignores 3-43 , 5-42 can tell me how skip strings , add doubles here? thanks all said 3 ie; "3, 3-43 , 4-42 strings either u read string , split , check number @ " , - or put in space between characters , integers. jvm after compilation tre...
Read more