国产成人精品久久免费动漫-国产成人精品天堂-国产成人精品区在线观看-国产成人精品日本-a级毛片无码免费真人-a级毛片毛片免费观看久潮喷

您的位置:首頁技術(shù)文章
文章詳情頁

python - 多線程中mysql插入出錯(cuò)

瀏覽:101日期:2022-06-28 16:07:14

問題描述

在寫爬蟲中,我要把爬取到的數(shù)據(jù)存到數(shù)據(jù)庫(kù)中.每一個(gè)頁面里邊有很多條目,比如一個(gè)人的訪客可能有很多個(gè),于是插入卸載循環(huán)中,

try: sql_visitor=’INSERT INTO visitor (ownername,owneruid,visitorname,visitoruid,visittime) VALUE ('%s',%d,'%s',%d,'%s')’%(ownername,owneruid,visitorname,visitoruid,visitortime) print sql_visitor self.cursor.execute(sql_visitor) self.connect.commit()except Exception as e: print e

一個(gè)頁面一個(gè)線程,嫌棄慢的我開了5個(gè)

max_threads=5while uid < 8000000 or threadlist: for thread1 in threadlist:if not thread1.is_alive(): threadlist.remove(thread1) while len(threadlist) < max_threads and uid < 8000000:uid+=1thread2=threading.Thread(target=run,args=(uid,))thread2.setDaemon(True)thread2.start()threadlist.append(thread2) time.sleep(5)

運(yùn)行很順利:

INSERT INTO visitor (ownername,owneruid,visitorname,visitoruid,visittime) VALUE ('huosai7',4893,'Liang2017',7252799,'2017-5-22 21:06')INSERT INTO personalinfo (ownername,owneruid,jifen,huajiao,xiaomijiao,jinbi,haoyou,zhuti,rizhi,xiangce,fenxiang,kongjianfangwenliang,youxiangyanzheng,shipinrenzheng,juzhudi,chushengdi,shangcifabiaoshijian,shangcihuodongshijian,zuihoufangwen,zhuceshijian,zaixianshijian,shengri,xingbie) VALUE('huosai7',4893,0,0,0,0,0,0,0,0,0,0,0,0,'','','2100-01-01 12:00','2100-01-01 12:00','2100-01-01 12:00','2004-1-3 19:28',0,'2100-01-01 12:00',0)INSERT INTO visitor (ownername,owneruid,visitorname,visitoruid,visittime) VALUE ('龍樂',4894,'Liang2017',7252799,'2017-5-22 21:06')(1062, 'Duplicate entry ’4894-7252799-2017-05-22 21:06:00’ for key ’PRIMARY’')INSERT INTO personalinfo (ownername,owneruid,jifen,huajiao,xiaomijiao,jinbi,haoyou,zhuti,rizhi,xiangce,fenxiang,kongjianfangwenliang,youxiangyanzheng,shipinrenzheng,juzhudi,chushengdi,shangcifabiaoshijian,shangcihuodongshijian,zuihoufangwen,zhuceshijian,zaixianshijian,shengri,xingbie) VALUE('龍樂',4894,0,0,0,0,0,0,0,0,0,0,0,0,'','','2100-01-01 12:00','2100-01-01 12:00','2100-01-01 12:00','2004-1-3 20:21',0,'2100-01-01 12:00',0).......

于是我將max_thread設(shè)置成10,于是結(jié)果如下:

INSERT INTO visitor (ownername,owneruid,visitorname,visitoruid,visittime) VALUE ('xiao61',4889,'Liang2017',7252799,'2017-5-22 21:06')

(2006, ’MySQL server has gone away’)

INSERT INTO personalinfo (ownername,owneruid,jifen,huajiao,xiaomijiao,jinbi,haoyou,zhuti,rizhi,xiangce,fenxiang,kongjianfangwenliang,youxiangyanzheng,shipinrenzheng,juzhudi,chushengdi,shangcifabiaoshijian,shangcihuodongshijian,zuihoufangwen,zhuceshijian,zaixianshijian,shengri,xingbie) VALUE('xiao61',4889,0,0,0,0,0,0,0,0,0,0,0,0,'','','2100-01-01 12:00','2100-01-01 12:00','2100-01-01 12:00','2004-1-3 15:56',0,'2100-01-01 12:00',0)

(2006, ’MySQL server has gone away’)

INSERT INTO visitor (ownername,owneruid,visitorname,visitoruid,visittime) VALUE ('糊涂酷酷熊',4897,'Liang2017',7252799,'2017-5-22 21:06')

(2006, ’MySQL server has gone away’)

INSERT INTO personalinfo (ownername,owneruid,jifen,huajiao,xiaomijiao,jinbi,haoyou,zhuti,rizhi,xiangce,fenxiang,kongjianfangwenliang,youxiangyanzheng,shipinrenzheng,juzhudi,chushengdi,shangcifabiaoshijian,shangcihuodongshijian,zuihoufangwen,zhuceshijian,zaixianshijian,shengri,xingbie) VALUE('糊涂酷酷熊',4897,611,0,1655,0,0,2,0,0,0,34,0,0,'','','2007-3-27 00:37','2007-3-27 00:37','2007-3-27 00:37','2004-1-3 21:08',0,'2100-01-01 12:00',1)

(2006, ’MySQL server has gone away’).......

可以看出2006出來了,然后我將max_thread設(shè)置成30,然后結(jié)果如下:

python - 多線程中mysql插入出錯(cuò)

就將,夠詳細(xì)嗎?不夠詳細(xì)還需要什么只管說!

問題解答

回答1:

看這里,我猜你是用的是pymysql,它的線程安全描述為1,對(duì)應(yīng)的pep249里面做了詳細(xì)的描述:

Threads may share the module, but not connections.

線程可以共享模塊但不能共享連接。這也就是說你可能得在每個(gè)線程中創(chuàng)建一個(gè)連接。

吶~為什么不用orm來做呢?

標(biāo)簽: Python 編程
相關(guān)文章:
主站蜘蛛池模板: 国产一区二区免费不卡在线播放 | 青青草国产免费国产是公开 | 俄罗斯aa毛片一级 | 日韩中文字幕在线视频 | 欧美日韩中文一区二区三区 | 久久草在线观看 | 免费小视频在线观看 | a级成人毛片免费视频高清 a级高清观看视频在线看 | 亚洲欧美在线观看视频 | 国产成人高清精品免费软件 | 最刺激黄a大片免费观看下截 | 韩国三级日本三级香港三级黄 | 亚洲综合久久久久久888 | 手机看片神马午夜 | 久久思思爱| 国产成人精品高清不卡在线 | 久久香蕉国产线看免费 | 日本国产最新一区二区三区 | 国产精品久久久天天影视香蕉 | 午夜国产精品不卡在线观看 | 日本三级香港三级人妇r | 高清欧美性xxxx成熟 | 性欧美高清久久久久久久 | 1024手机基地在线看手机 | 久久国内免费视频 | 大美女香蕉丽人视频网站 | 曰本美女高清在线观看免费 | 性欧美巨大的视频 | 国产一区二区三区在线观看精品 | 国产成人精品亚洲777图片 | 国产三级在线免费 | 国产手机精品视频 | 一级女毛片 | 国产精品久久久久久久久久久威 | 最新国产大片高清视频 | 成年人免费小视频 | 亚洲欧美一级视频 | 国产在线一区二区三区 | 激情6月丁香婷婷色综合 | 日韩欧美a级高清毛片 | 国产婷婷成人久久av免费高清 |