Upwork - Python Data Engineer-Data Harvester Agent
Destaque

Python Data Engineer-Data Harvester Agent

Upworkvia Upwork
RemotoRemotoPlenoCLT4 dias atrás

Salário Estimado

R$ 9.108,00 - R$ 13.662,00

Tecnologias

PythonGoPostgreSQLAPIRESTIA
0de 100

Excelente

Score da Vaga

Descrição da Vaga

We operate a defense procurement intelligence platform that predicts Navy and Air Force parts demand 180-274 days before solicitation posts.


We need 5 nightly data harvesting scripts built, tested, and deployed on a Mac Mini server.


SCOPE: 1.


SAM.gov API harvester • Daily pull of DLA contract awards filtered by Navy + AF platforms

•Filter by FSC/NSN, output structured JSON • SAM API key provided 2.

USASpending.gov harvester • Daily pull by platform/FSC code

•Fix existing broken .env path on current script (script provided) • Output structured JSON 3.

FPDS Award Gap Scanner • Query FPDS-NG for NSNs with no award in 18+ months

•Navy + AF platforms only • Flag as pre-solicitation signal 4.

GAO Readiness Report Scraper • Scrape gao.gov for published reports

•Keywords: parts readiness, obsolescence, sustainment failure • Extract: installation name, platform mentioned, report date, URL 5.

DSCA FMS Case PDF Parser • Pull Foreign Military Sales case PDFs from dsca.mil

•Extract NSNs using pdfplumber • Match against known Navy/AF platform NSN list DEPLOYMENT:
•All 5 scripts write to PostgreSQL database (credentials provided) • Summary records sync to Airtable (API key provided)
•Each script deployed as launchd agent on Mac Mini, scheduled nightly 2-4am • time.sleep(0.5) between all external requests required
•Error logging to ~/Library/PRISM/logs/ REQUIREMENTS:
•Python, REST APIs, BeautifulSoup, pdfplumber, PostgreSQL, Airtable API
•launchd/macOS deployment experience • Defense or government data experience a plus
•Timeline: 4 days max • Fixed price preferred
•Deliverable: all 5 scripts live + verified log output showing successful nightly run

Vagas Semelhantes

Jobs Ai - Vaga Full Stack Developer (Remote)

Full Stack Developer (Remote)

Jobs AiBeBee
RemotoRemotoHoje

R$ 9k - 14k/mês

PlenoCLT

• Role: Full Stack Developer (Remote) • Location : Remote • Payout : $50 - $120/hour Role Overview We are hiring a Full Stack Developer to build and scale modern web applications end-to-end. In this role, you will work across React on the frontend and Node.js, Python, or Go on the backend to deliver...

TypeScriptReactNodePythonGo+10
Ver Detalhes
HTC Global Services - Vaga Sr. AI/Machine Learning Engineer

Sr. AI/Machine Learning Engineer

HTC Global ServicesLinkedIn
RemotoRemotoHoje

R$ 10k - 15k/mês

PlenoCLT

Job Title: AI/ML Software Engineer Overview / Summary The AI/ML Software Engineer will design and build software tools that incorporate AI/ML techniques to automate narrowly defined tasks, assist internal users, and improve external user interactions. This role involves developing solutions such as ...

ReactAngularPythonJavaGo+14
Ver Detalhes
Proa.Ai - Vaga Desenvolvedor Back-End

Desenvolvedor Back-End

Proa.AiJobLeads
Primavera Do Leste, Mato Grosso, BrHoje

R$ 8k - 11k/mês

PlenoCLT

Descrição do cargo Atuar no desenvolvimento, manutenção e evolução de soluções back‑end, garantindo performance, escalabilidade, segurança e qualidade de código. Esse profissional será responsável por desenhar e implementar APIs, realizar integrações entre sistemas internos e externos e apoiar decis...

NodePythonJavaGoPostgreSQL+5
Ver Detalhes
Kstack - Vaga Desenvolvedor(a) Python/Django Pleno

Desenvolvedor(a) Python/Django Pleno

KstackMelhores Empregos
Joinville, Santa Catarina, BrHoje

R$ 6k - 10k/mês

PlenoCLT

Estamos em busca de um profissional com sólida experiência no ecossistema Python para atuar no desenvolvimento de soluções escaláveis e de alta qualidade. Se você possui autonomia técnica, preza por boas práticas de arquitetura e deseja impactar diretamente a evolução dos nossos produtos, queremos t...

ReactAngularVuePythonGo+8
Ver Detalhes

Interessado nesta vaga?

Candidatar-se

Você será redirecionado para o site original

Informações

NívelPleno
ContratoCLT
LocalRemoto
RemotoSim
MoedaBRL
Publicada4 dias atrás
FonteUpwork

Análise de Vaga com IA

Estimativa salarial, match de tecnologias e análise de requisitos feitos com Inteligência Artificial

Quer se preparar melhor? Pratique entrevistas com IA no Recrutadoria ou melhore suas habilidades no BitMentor

← Voltar às Vagas