国产成人精品久久免费动漫-国产成人精品天堂-国产成人精品区在线观看-国产成人精品日本-a级毛片无码免费真人-a级毛片毛片免费观看久潮喷

您的位置:首頁技術(shù)文章
文章詳情頁

python - 多線程中mysql插入出錯(cuò)

瀏覽:101日期:2022-06-28 16:07:14

問題描述

在寫爬蟲中,我要把爬取到的數(shù)據(jù)存到數(shù)據(jù)庫(kù)中.每一個(gè)頁面里邊有很多條目,比如一個(gè)人的訪客可能有很多個(gè),于是插入卸載循環(huán)中,

try: sql_visitor=’INSERT INTO visitor (ownername,owneruid,visitorname,visitoruid,visittime) VALUE ('%s',%d,'%s',%d,'%s')’%(ownername,owneruid,visitorname,visitoruid,visitortime) print sql_visitor self.cursor.execute(sql_visitor) self.connect.commit()except Exception as e: print e

一個(gè)頁面一個(gè)線程,嫌棄慢的我開了5個(gè)

max_threads=5while uid < 8000000 or threadlist: for thread1 in threadlist:if not thread1.is_alive(): threadlist.remove(thread1) while len(threadlist) < max_threads and uid < 8000000:uid+=1thread2=threading.Thread(target=run,args=(uid,))thread2.setDaemon(True)thread2.start()threadlist.append(thread2) time.sleep(5)

運(yùn)行很順利:

INSERT INTO visitor (ownername,owneruid,visitorname,visitoruid,visittime) VALUE ('huosai7',4893,'Liang2017',7252799,'2017-5-22 21:06')INSERT INTO personalinfo (ownername,owneruid,jifen,huajiao,xiaomijiao,jinbi,haoyou,zhuti,rizhi,xiangce,fenxiang,kongjianfangwenliang,youxiangyanzheng,shipinrenzheng,juzhudi,chushengdi,shangcifabiaoshijian,shangcihuodongshijian,zuihoufangwen,zhuceshijian,zaixianshijian,shengri,xingbie) VALUE('huosai7',4893,0,0,0,0,0,0,0,0,0,0,0,0,'','','2100-01-01 12:00','2100-01-01 12:00','2100-01-01 12:00','2004-1-3 19:28',0,'2100-01-01 12:00',0)INSERT INTO visitor (ownername,owneruid,visitorname,visitoruid,visittime) VALUE ('龍樂',4894,'Liang2017',7252799,'2017-5-22 21:06')(1062, 'Duplicate entry ’4894-7252799-2017-05-22 21:06:00’ for key ’PRIMARY’')INSERT INTO personalinfo (ownername,owneruid,jifen,huajiao,xiaomijiao,jinbi,haoyou,zhuti,rizhi,xiangce,fenxiang,kongjianfangwenliang,youxiangyanzheng,shipinrenzheng,juzhudi,chushengdi,shangcifabiaoshijian,shangcihuodongshijian,zuihoufangwen,zhuceshijian,zaixianshijian,shengri,xingbie) VALUE('龍樂',4894,0,0,0,0,0,0,0,0,0,0,0,0,'','','2100-01-01 12:00','2100-01-01 12:00','2100-01-01 12:00','2004-1-3 20:21',0,'2100-01-01 12:00',0).......

于是我將max_thread設(shè)置成10,于是結(jié)果如下:

INSERT INTO visitor (ownername,owneruid,visitorname,visitoruid,visittime) VALUE ('xiao61',4889,'Liang2017',7252799,'2017-5-22 21:06')

(2006, ’MySQL server has gone away’)

INSERT INTO personalinfo (ownername,owneruid,jifen,huajiao,xiaomijiao,jinbi,haoyou,zhuti,rizhi,xiangce,fenxiang,kongjianfangwenliang,youxiangyanzheng,shipinrenzheng,juzhudi,chushengdi,shangcifabiaoshijian,shangcihuodongshijian,zuihoufangwen,zhuceshijian,zaixianshijian,shengri,xingbie) VALUE('xiao61',4889,0,0,0,0,0,0,0,0,0,0,0,0,'','','2100-01-01 12:00','2100-01-01 12:00','2100-01-01 12:00','2004-1-3 15:56',0,'2100-01-01 12:00',0)

(2006, ’MySQL server has gone away’)

INSERT INTO visitor (ownername,owneruid,visitorname,visitoruid,visittime) VALUE ('糊涂酷酷熊',4897,'Liang2017',7252799,'2017-5-22 21:06')

(2006, ’MySQL server has gone away’)

INSERT INTO personalinfo (ownername,owneruid,jifen,huajiao,xiaomijiao,jinbi,haoyou,zhuti,rizhi,xiangce,fenxiang,kongjianfangwenliang,youxiangyanzheng,shipinrenzheng,juzhudi,chushengdi,shangcifabiaoshijian,shangcihuodongshijian,zuihoufangwen,zhuceshijian,zaixianshijian,shengri,xingbie) VALUE('糊涂酷酷熊',4897,611,0,1655,0,0,2,0,0,0,34,0,0,'','','2007-3-27 00:37','2007-3-27 00:37','2007-3-27 00:37','2004-1-3 21:08',0,'2100-01-01 12:00',1)

(2006, ’MySQL server has gone away’).......

可以看出2006出來了,然后我將max_thread設(shè)置成30,然后結(jié)果如下:

python - 多線程中mysql插入出錯(cuò)

就將,夠詳細(xì)嗎?不夠詳細(xì)還需要什么只管說!

問題解答

回答1:

看這里,我猜你是用的是pymysql,它的線程安全描述為1,對(duì)應(yīng)的pep249里面做了詳細(xì)的描述:

Threads may share the module, but not connections.

線程可以共享模塊但不能共享連接。這也就是說你可能得在每個(gè)線程中創(chuàng)建一個(gè)連接。

吶~為什么不用orm來做呢?

標(biāo)簽: Python 編程
相關(guān)文章:
主站蜘蛛池模板: 国产精品久久久久影院 | 欧美大片国产在线永久播放 | 午夜大片免费男女爽爽影院久久 | 日韩国产欧美精品综合二区 | 亚洲视频国产精品 | 美国一级毛片不卡无毒 | ririai99在线视频观看 | 国产精品天天爽夜夜欢张柏芝 | 国产精品影视 | 日本在线观看不卡免费视频 | 97国产在线播放 | a级成人毛片免费视频高清 a级高清观看视频在线看 | 免费国产黄网站在线观看视频 | 一区二区三区亚洲视频 | 99热热久久这里只有精品166 | 国产成人毛片精品不卡在线 | 嫩草影院ncyy在线观看 | 国产成a人片在线观看视频 国产成版人视频网站免费下 | 国产三级小视频 | 国产成人久久综合二区 | 亚洲精品久久久久午夜三 | 亚州综合网 | 国产一有一级毛片视频 | 国产精品手机在线播放 | 最近日本免费观看视频 | 999久久| 免费播放aa在线视频成人 | 伊人情人综合网 | 日韩视频在线观看 | 亚洲免费观看视频 | 在线看片亚洲 | 99久久亚洲国产高清观看 | 91高端极品外围在线观看 | 欧美理论片在线观看一区二区 | 亚洲日本欧美综合在线一 | 深夜国产成人福利在线观看女同 | 久久精品一区二区三区四区 | 一级毛片免费观看不卡视频 | 国产精品日韩一区二区三区 | 欧美日韩中文字幕在线视频 | 欧美亚洲视频在线观看 |