GDI / Document Intelligence & NLP Specialist

ATS+Partners
  • Boston, Massachusetts
  • Autofill and Review
30+ days ago

Job Description

ATS+Partners is seeking a GDI / DocumentIntelligence & NLP Specialist who brings verifiable, multi-year experienceimplementing Intelligent Document Processing and Generative DocumentIntelligence solutions — ideally for government or regulated-industry clients —with documented extraction accuracy benchmarks from prior deployments. Thisrole exists specifically to address the two most consequential gaps in thecurrent proposal:

Minimum Criterion 1 requires five or more years ofexperience implementing AI Automation and GDI solutions, preferably formunicipal or government clients. The contractor’s own professional history mustprovide the concrete, dated implementation record that satisfies thisthreshold.

Minimum Criterion 2 requires a proven ability toachieve 80%+ data extraction accuracy on unstructured documents. The contractormust be able to supply documented benchmark results from prior engagements —not theoretical capability claims — that an evaluator can verify.

The contractor will serve as the project’sextraction engine expert, responsible for the design, configuration, andcontinuous improvement of all AI document extraction pipelines. They will ownprompt engineering for all four target workflows, configure the modelensemble’s consensus logic, build the field-level confidence scoring framework,and manage the human-in-the-loop feedback loop that drives continuous accuracyimprovement throughout the three-year contract term.

PRIMARY RESPONSIBILITIES

Design and configure AI extraction pipelines for allfour target workflows: Invoice Processing, Vehicle Insurance CertificateReconciliation, Health Insurance Reconciliation, and Audit Preparation.

Develop and maintain custom prompt templates for GPT-4oand Claude AI, including field extraction schemas in JSON format, field-levelinstructions with positive and negative examples, chain-of-thought validationprompts, and conditional extraction rules.

Configure the LangGraph consensus orchestration layer:define how discrepancies between the two model outputs are resolved, whatconfidence thresholds trigger automatic pass-through vs. HITL routing, and howreviewer corrections are captured in graph state for retraining.

Build and manage the document classification pipeline:design the taxonomy for audit document categorization, train or configure theclassifier against City document samples, and validate classification accuracy.

Establish and execute the accuracy benchmarkingprotocol: define hold-out test sets for each workflow, run pre-pilot benchmarks, pilot accuracy benchmarks, and quarterly productionaccuracy audits.

Lead prompt regression testing: maintain a library ofannotated sample documents that are re-run against every prompt update andmodel version change to detect accuracy regressions before they reachproduction.

Manage the continuous learning loop: export reviewercorrections from the HITL queue, curate training data, coordinate modelfine-tuning or prompt updates on a quarterly basis.

Configure pre-processing pipeline parameters: imagequality thresholds, deskewing settings, multi-page document segmentation rules,and PDF/A normalization parameters for each document type.

Provide domain-specific extraction expertise for ACORDinsurance certificates, government invoices, AP aging schedules, GL trialbalances, and health insurance enrollment forms.

Document all extraction schemas, prompt versions,confidence threshold configurations, and model accuracy results in aversion-controlled Model Registry maintained throughout the contract.

Requirements

AI/GDI implementation experience: 5+ years implementing Intelligent DocumentProcessing or Generative Document Intelligence solutions in production environments

Confidence scoring and HITL design: experience building tiered confidence routing logic connecting AI extraction outputs to human review queues

Documented extraction accuracy benchmarks: must be able to provide benchmark results (with methodology) from at least two prior IDP deployments showing 80%+ field-level extraction accuracy on unstructured documents

Government or regulated-industry IDP: at least two prior GDI/IDP implementations for government agencies, financial institutions, insurance carriers, or healthcare organizations

Azure AI DocumentIntelligence (Form Recogniser): 2+ years hands-on configuration of pre-built and custom models for invoice, form, and certificate extraction

Pre-processing pipeline: hands-on experience with PDF normalization, image quality scoring, deskewing, and format conversion as part of a production IDP pipeline

LLM prompt engineering: 2+ years designing structured extraction prompts for GPT-4o,Claude, or equivalent models, including JSON schema output, chain-of-thought prompting, and regression testing

RAG integration: experience connecting LLM extraction pipelines to vector search (Azure AISearch, Pinecone, or equivalent) for cross-reference validation

Document classification: experience training or configuring document classifiers for multi-category taxonomies in financial or government document environments

Model accuracy reporting: ability to produce evaluator-grade benchmark reports with field-level precision, recall, and F1 metrics

PREFERRED QUALIFICATIONS

Massachusetts municipal or state government IDP experience: prior deployment of a document intelligence solution for a Massachusetts city, town, or state agency (highest priority preference)

LangGraph orLangChain: hands-on experience building stateful multi-agent extraction workflows with checkpointing and HITL interrupt/resume patterns

Insurance document expertise: specific experience extracting from ACORD certificates of insurance, health insurance enrollment files, or explanation-of-benefits documents

Ensemble architecture: experience building multi-model consensus extraction systems with model-specific confidence weighting

Invoice and AP document expertise: experience with multi-vendor invoice extraction including edge cases (handwritten amounts, multi-page invoices, non-standard layouts)

Audit document expertise: experience with trial balance extraction, GL account mapping, and financial work paper generation from source documents

HIPAA-compliant AI pipelines: prior implementation of GDI solutions in HIPAA-governed environments, including PHI tokenization and BAA-covered model usage

Fine-tuning and continuous learning: experience running RLHF-style feedback loops or few-shot fine-tuning on domain-specific document corpora

ABBYY Vantage: experience configuring ABBYY for degraded scan processing alongside primaryAzure AI Document Intelligence pipeline

Python: proficiency for custom extraction logic, pre-processing scripts, and benchmarking tooling

Benefits

Company Benefits for Contractors

·Flexible,project-based consulting opportunities with the ability to work across diversepublic, private, and nonprofit sector IT initiatives.

·Exposure tohigh-impact digital transformation, infrastructure modernization,cybersecurity, cloud, and AI-enabled projects that strengthen your portfolioand technical expertise.

·Collaborativepartnership model that values consultant input, innovation, and professionalautonomy while working alongside experienced client and project leadershipteams.

·Competitive contractor compensation with opportunities for repeatengagements, long-term client relationships, and expansion into strategicadvisory or technical leadership roles.

Numbers & Facts

LocationBoston, Massachusetts

Skills

  • Accounts Payableunmatched
  • Adobe Acrobatunmatched
  • Artificial Intelligence (AI)unmatched
  • Automationunmatched
  • Benchmarkingunmatched
  • Billingunmatched
  • Cloud Computingunmatched
  • Concreteunmatched
  • Consultingunmatched
  • Continuous Improvementunmatched
  • Customer Relationsunmatched
  • Document Managementunmatched
  • Format Conversionunmatched
  • Governmentunmatched
  • Government Billingunmatched
  • HIPAA (Health Insurance Portability and Accountability Act)unmatched
  • Health Insuranceunmatched
  • Healthcareunmatched
  • Insuranceunmatched
  • Insurance Documentationunmatched
  • Internet Securityunmatched
  • JSONunmatched
  • Machine Toolunmatched
  • Microsoft Windows Azureunmatched
  • Natural Language Processing (NLP)unmatched
  • Nonprofitunmatched
  • Production Systemsunmatched
  • Python Programming/Scripting Languageunmatched
  • Reconciliationunmatched
  • Regression Testingunmatched
  • Scripting (Scripting Languages)unmatched
  • State Governmentunmatched
  • Taxonomiesunmatched
  • Technical Leadershipunmatched

Be found by employers

5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

Level up your application

Professional resume templates

Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

Free resume templates

Free resume builder

Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

Free resume builder