o ,fr.@sddlmZmZmZmZmZmZmZddlZddl m Z ddl Z ddl Z ddlmZddlmZmZddlZddlZddlZddlmZmZddlZddlmZmZdadaejejdee Z!ee Z"e Z#d e_$d d iZ%e"&d d dZ'e"&dddZ(e#j)ddZ)e"j&dddgde#j*ddZ+e"&de#j*ddZ,ddZ-dd Z.d!d"Z/d#d$Z0d%d&Z1d'd(Z2d)d*Z3d+d,Z4d-d.Z5e d/kre"j6d0d1dSdS)2)ResponseFlaskrequestrender_template send_fileredirecturl_forN) HTTPBasicAuth) BeautifulSoup)urljoinurlparse)StringIOBytesIO)r parse_qs)levelz8sk-proj-g5KUovMAPblK2YVhYFWYT3BlbkFJbRnn3OubcnZrWyodkjQkZadminZsecretz /favicon.icocCsdS)N)rrr4D:\Karim projects\Glue stance inc\aiform\formauto.pyfavicon#rz /progresscCsdd}t|ddS)Ncss>ttkrdtttddVtdttksdSdS)Nzdata: )total processedz )processed_urls total_urlsjsondumpstimesleeprrrrgenerate*s  zprogress..generateztext/event-stream)mimetype)r)r rrrprogress(sr"cCs |tvr t||kr|SdSdSN)users)usernamepasswordrrrverify_password1sr'/GETPOST)methodsc Cstjdkrgtjd}|re|jredadat|}|d}tj dtj dtj dtj dtj d tj d tj d tj d tj d tj dtj dd }t ||}t |ddddSdSt dS)Nr*filerZURL company_name full_namekanaemail phone_numberaddress postal_code departmentpositionsite_urlmessage) r-r.r/r0r1r2r3r4r5r6r7Tzprocessing_report.csvztext/csv)Z as_attachmentZ download_namer!z"No file selected or file is empty.z upload.html)rmethodfilesfilenamerrpdZread_csvtolistformget process_urlsrr)r,dfurls user_inforeportrrr upload_file6s.                 rDz/logoutcCs ttdS)NrD)rrrrrrlogoutVs rEcCst|adat}t}t|}|gd|D]}|g}z| |}| | dt |}| dt|dd} ||gD]X} z7| | }t |jd} t| } | r}t| |} t|| | \}}|r}|| ddtj| dd|d gd } WqWqEty}ztd | d t|WYd}~qEd}~ww| s|gd Wn(tjy}z|dt|d d d d d d d t|g WYd}~nd}~ww||td7atttq|d}t|}|d|S)Nr)zMain URLz URL Accessz Links FoundzForm URLzForm Fields FoundzSubmitted Form DatazSubmission Verificationz Error DetailsZSuccesszFound z linksF html.parser) ensure_asciirTzError processing URL z: )N/Az Failure - No suitable form foundrrrrrHNo form submittedz Failure - rzutf-8)lenrrrequestsZSessionr csvwriterZwriterowr>raise_for_statusappend get_all_linksr textfind_form_fieldsgenerate_form_mappingfind_and_submit_formextendrr ExceptionloggererrorstrZRequestExceptionupdate_progressgetvalueencoderseek)rArBsessionrCZ csv_writerZmain_urlrowresponseZ all_linksZform_submittedurlsoupfields form_dataZsubmission_resultZsubmission_verificationeZreport_contentZ report_bytesrrrr?[sl          6   r?cCshg}|dD]*}|gdD] }|jdkr)|dd}|dvr(|t|q|t|qq|S)Nr=inputZtextareaselectrgtyperQ)rQr0telcheckboxradioZhidden)find_allnamer>rOrY)rbrcr=elementZ input_typerrrrRs  rRc Cst|j}t|}t|jd}dd|jdddD}g}|D]}t||}t|j}||ks8d|vs8d|vr=||q |S) NrFcSsg|]}|dqSZhref)r>).0arrr sz!get_all_links..rrTrpz forms.glezdocs.google.com) r netlocrKr>r rQrmr rO) radomainr`rblinksZ full_linkslinkZ full_linkZ link_domainrrrrPs      rPcCsd|d|dd|dd|dd|dd |d d |d d |dd|dd|dd|dd|dd|dd}tjjddddd|dgdd }t|d!d"dd#}|S)$NaG Given the following form fields and user information, identify the corresponding input names in the form and map them to the provided values. Handle checkboxes, radio buttons, and select fields appropriately. Fill all inputs and select the most appropriate option in checkboxes or radio buttons. Form Fields: u+ User Information: 会社名: r-u 名前（姓名）: r.u ふりがな: r/u フリガナ: u メールアドレス: r0u 電話番号: r1u 住所: r2u 郵便番号: r3u 部署名: r4u 役職: r5u サイトURL: r6u メッセージ: r7z For checkboxes and radio buttons, set the value to "true" for the closest option to the user information, otherwise "false". For select fields, choose the most appropriate option based on the user information. z gpt-3.5-turbosystemzYou are a sales representative. Please respond with a JSON object mapping form field names to user information values. For checkboxes and radio buttons, use boolean values. For select fields, provide the value of the most appropriate option.)Zrolecontentuseri)modelmessagesZ max_tokenschoicesrry)openaiZChatCompletionZcreaterloads)rcrBpromptr`Z form_mappingrrrrSsH      rSc s||}t|jd}|d}td||D]}|d}|dd}|gd} i} | D]Z} | d} | jd krH| d d nd } | r| d ksT| d krd|| dkrc| dd| | <q4| jdkr| d}|D]}|d|| kr|d| | <q4qp|| d | | <q4z,t||tdd| d| Gfddd}|}t |}d|fWSt y}zt dt |WYd}~qd}~wwdS)NrFr=zforms founds: actionr8r>rfrnrgrirrkrlTvalueonrhoptionzWould submit form to z with method z and payload: cs eZdZfddZddZdS)z*find_and_submit_form..MockResponsecsd|_d|_|_dS)Nz7Thank you for your submission)Z status_coderQraselfZ submit_urlrr__init__ s z3find_and_submit_form..MockResponse.__init__cSsdSr#rrrrrrNsz;find_and_submit_form..MockResponse.raise_for_statusN)__name__ __module__ __qualname__rrNrrrr MockResponse s  rzForm processing failed: )FrI)r>r rQrmrWinfolowerrnr upperverify_submissionrVrXrY)r^rardr`rbZformsr=Z form_actionZ form_methodZ form_inputspayloadroZ element_nameZ element_typeoptionsrrZsubmit_responseZverification_resultrerrrrTsN           rTcCsxt|jd}gd}|}|D]}||vr d|dSq|ds(dStt|jj}d|vs8d|vr:d Sd S) NrF)z thank yousuccess submittedZreceivedz%Submission likely successful. Found 'z' on the response page.r=zCForm no longer present on the page. Submission might be successful.rrz.URL parameters indicate successful submission.z;Unable to verify submission success. Please check manually.) r rQZget_textrfindrr raquery)r`rbZsuccess_keywordsZ page_textkeywordZ url_paramsrrrrs   rcCs |a|adSr#)rr)rrrrrrZ3srZcCtSr#)rrrrrget_total_urls8rrcCrr#)rrrrrget_processed_urls<rr__main__T)debug)7flaskrrrrrrrrZflask_httpauthr pandasr;rKZbs4r urllib.parser r r~rLrior rZloggingrrrZ basicConfigINFOZ getLoggerrrWappauthZapi_keyr$Zrouterr"r'Zlogin_requiredrDrEr?rRrPrSrTrrZrrrunrrrrs\$        O  $5