python pandas Access Excel MemoryError -


all,

i've been trying use pandas in python load table access write data excel file see following code:

when running code (python 3.5.2) receive following output:

<!-- language: python -->  import pandas pd import pypyodbc  conn = 'dsn=mydsntest'  cnxn = pypyodbc.connect(conn) crsr = cnxn.cursor() qy = """select * mytbl;""" df = pd.read_sql(qy, cnxn)  cnxn.commit() crsr.close() cnxn.close()  print ("read dataframe") #writer = pd.excelwriter('c:/tmp/test.xlsx') #df.to_excel(writer, 'data')  df.to_excel('e:/reports/analyticsinput/tblhistoryac.xlsx', data',index=false)  # close pandas excel writer , output excel file. #writer.save()

read dataframe 199966 traceback (most recent call last):
file "c:\users\jeff\test.py", line 23, in
df.to_excel('c:/tmp/mytest.xlsx', 'data', index=false) file "c:\python35-32\lib\site-packages\pandas\core\frame.py", line 1466, in to_excel
excel_writer.save() file "c:\python35-32\lib\site-packages\pandas\io\excel.py", line 790, in save
return self.book.save(self.path) file "c:\python35-32\lib\site-packages\openpyxl\workbook\workbook.py", line 345, in save
save_workbook(self, filename) file "c:\python35-32\lib\site-packages\openpyxl\writer\excel.py", line 266, in save_workbook
writer.save(filename) file "c:\python35-32\lib\site-packages\openpyxl\writer\excel.py", line 248, in save
self.write_data() file "c:\python35-32\lib\site-packages\openpyxl\writer\excel.py", line 81, in write_data
self._write_worksheets() file "c:\python35-32\lib\site-packages\openpyxl\writer\excel.py", line 197, in _write_worksheets
xml = ws._write() file "c:\python35-32\lib\site-packages\openpyxl\worksheet\worksheet.py", line 870, in _write
return write_worksheet(self) file "c:\python35-32\lib\site-packages\openpyxl\writer\worksheet.py", line 107, in write_worksheet
write_rows(xf, ws) memoryerror

while file 200,000 rows i'd have believe there else or way produce xlsx file without getting memory error.

any ideas? thanks!
jeff


Comments

Post a Comment

Popular posts from this blog

PHP and MySQL WP -

i trying accomplish 2 things here code. writing php directly wp page using insert php plugin. 1) query mysql database , return results 1 column 4 columns. 2) make each result own hyperlink directs user new wp page runs new query on page. i able query show results , turn results dynamic hyperlink, cannot formatting down. right returns result 1 column. here have: [insert_php] $servername = "localhost"; $username = "login"; //edited privacy $password = "password"; //edited privacy $database = "database"; //edited privacy // create connection $conn = new mysqli($servername, $username, $password, $database); // check connection if ($conn->connect_error) { die("connection failed: " . $conn->connect_error); } echo "connected successfully"; //get results database $result = mysqli_query($conn,"select mine mines order mine"); $all_property = array(); //declare array saving property //showing proper...
Read more

android - InAppBilling registering BroadcastReceiver in AndroidManifest -

i'm implementing inapp billing in android app. works well, however, i'm trying decouple broadcast receiver activity manifest. suggestion in android's trivialdrive sample: // important: dynamically register broadcast messages updated purchases. // register receiver here instead of <receiver> in manifest // because call getpurchases() @ startup, therefore can ignore // broadcasts sent while app isn't running. // note: registering listener in activity bad idea, done here // because sample. regardless, receiver must registered after // iabhelper setup, before first call getpurchases(). currently there's class extends broadcastreceiver : public class iabbroadcastreceiver extends broadcastreceiver { /** * intent action receiver should filter for. */ public static final string action = "com.android.vending.billing.purchases_updated"; private final iabbroadcastlistener mlistener; public iabbroadcastreceiver(iabbroadcastlistener listener) { m...
Read more

go - golang pprof for c library code -

i have been trying profile golang application pprof, seems details of c code(linked static library) missed in output result. flame graph from frame graph can see c code time consuming reported within "runtime._externalcode", no details @ all. , sure static library compiled debug enable. so there way make pprof details(like stack trace) of 3rd party c code? or there other golang profiling tool this?
Read more