|vjX UdZddlZddlZddlZddlZddlmZmZddlmZee jdz Z e jdiZ eeej fed<ej Zd ed ej fd Zd ed efd Zd ed efd Zddeededzd efdZd ed efdZd efdZd ed edzfdZd ed efdZd efdZd eefdZy)uJ Job storage: each uploaded file becomes a "job" with its own isolated directory (named by a random UUID, never derived from user input) containing the raw upload, the cleaned/rejected Parquet outputs, and a status file. Kept intentionally simple (filesystem + JSON status file) for an MVP that's easy to self-host. For heavier production use, swap the in-memory job lock and background-thread execution for a real task queue (Celery/RQ/Arq) and the status file for a row in Postgres/Redis — the interface here (`create_job`, `get_status`, `set_status`) is small enough to swap out. N)datetimetimezone)PathdataT)exist_ok_locksjob_idreturnct5|tvrtjt|<t|cdddS#1swYyxYwN) _locks_guardr threadingLockr s */var/www/html/lead-cleaner/backend/jobs.py _job_lockrs.   &^^-F6Nf~ s ,=Act|z }|Sr )DATA_DIRr ds rjob_dirr"s 6A Hct|dz S)Ninputsrrs r inputs_dirr)s 6?X %%roriginal_filenames created_byc "tjj}t|}|j dd|dz j t |d||t jtjj|S)NTF)parentsrrpending)statusrr created_at) uuiduuid4hexrmkdir set_statusrnowrutc isoformat)rrr rs r create_jobr,-sp ZZ\  FAGGD5G)\-<< -779  Mrct|dz S)Nz status.jsonrrs r status_pathr.<s 6?] **rc t|5t|}i}|jr#tj|j }|j |tjtjj|d<|jtj|tdddy#1swYyxYw)N updated_at)default)rr.existsjsonloads read_textupdaterr)rr*r+ write_textdumpsstr)r fieldspexistings rr(r(@s 6    88:zz!++-0H!)hll!;!E!E!G TZZ#67   s B0CCct|}|jsytj|j Sr )r.r2r3r4r5)r r;s r get_statusr>Ks-FA 88: ::akkm $$rc4t|jSr )rr2rs r job_existsr@Rs 6? ! ! ##rct|}|jrtj|t5t j |ddddy#1swYyxYwr )rr2shutilrmtreer rpoprs r delete_jobrEVs;Axxz a  64  s AA ctjDcgc]}|js|j!c}Scc}wr )riterdiris_dirname)r;s r list_jobsrJ^s1$,,. =.q!((*AFF. == =s>>r )__doc__r3rBr$rrrpathlibr__file__parentrr'rdictr9r__annotations__r rrrlistr,r.r(r>boolr@rErJrrrTs+  ' > 6 )$&S).. !&y~~ cinn C D &s&t& 49 #* PS +++8s8%s%td{%$s$t$!s!>49>r