Debug Run: policy-001-en

Extracted Data

Comparison

Fields

Raw Text

Prompts

Schema

LLM Extracted Data

{
"approver": {
"name": "Kristopher Lowe"
},
"definitions": [
{
"definition": "Totidem inventore abstergo tot.",
"term": "functionalities"
},
{
"definition": "Cado stultus sto provident ducimus complectus.",
"term": "paradigms"
},
{
"definition": "Terminatio testimonium tener undique admitto consuasor natus.",
"term": "blockchains"
},
{
"definition": "Vergo ars decipio.",
"term": "technologies"
}
],
"department": "Electronics",
"effectiveDate": "2025-08-02",
"owner": {
"name": "Teresa Effertz Jr."
},
"policyName": "TRAVEL \u0026 EXPENSE",
"policyNumber": "POL-XVAT",
"purpose": "Catena vomica vado dolores eum solus. Tamisium uxor una curo ultio crustulum tolero. Decerno sulum tubineus\ncaste conduco trans tumultus confero casus.",
"scope": "Ver curso ustulo confido tego arguo conculco bene dedecor. Talus clam theologus aedificium. Unus virtus viridis\ndapifer vilitas.",
"sections": [
{
"content": "Quaerat casus tricesimus cuius auctus aestas titulus. Velum aliquam cernuus statua officia tener vulgo. Nostrum\nvereor barba cerno quas. Accedo acidus libero unus comparo video aranea alter templum ulterius. Varietas\ncoadunatio aperte paens. Ulciscor umbra id.",
"number": "1",
"title": "web services"
},
{
"content": "Arbitro aedificium supra. Similique solium arbor cruciamentum. Vociferor vestrum solitudo anser umquam ver\nciminatio. Aestivus vulgo templum praesentium eveniet adicio. Nobis venustas ceno quibusdam tenuis tutis sol\nutilis. Volutabrum vulgus decipio verbera uterque.",
"number": "2",
"title": "synergies"
},
{
"content": "Caput spiritus illo summisse vado cruciamentum maiores amaritudo summopere. Decretum vel paens aequitas\ndecretum appositus ulterius officia recusandae bene. Tantum capillus pauper tolero calcar cunae valde. Quis\nnumquam creo cena subvenio conforto vulticulus tunc tonsor. Voluptas ustilo cometes conitor amplus quisquam\ndegusto. Tum sunt ait volutabrum vigor inflammatio maxime cur tamisium.",
"number": "3",
"title": "large language models"
},
{
"content": "Laborum amissio tracto debitis pecus confugo demergo adicio unde. Sto cultellus basium. Beatae titulus\ndefessus ultra aeternus aegrotatio strues vester inflammatio. Tametsi placeat est quam attero. Desidero ut\naccendo coerceo sub coruscus. Atque aranea coadunatio deprecator pecus coniuratio vehemens.",
"number": "4",
"subsections": [
{
"number": "4.1",
"title": "deliver: Compono decumbo amplexus thorax auctus confero demo termes. Tripudio tergiversatio tribuo vel\ntunc cunctatio. Cupiditas abbas cunabula aequus rem culpa ab tamdiu tenetur."
},
{
"number": "4.2",
"title": "orchestrate: Aeternus tergo infit conatus vita reiciendis eveniet. Tondeo vigilo facere perferendis attollo.\nToties summopere advenio adulatio solio tametsi cito porro contego universe."
},
{
"number": "4.3",
"title": "gamify: Deficio demergo triumphus unde adimpleo derideo coniecto baiulus vulariter. Assentator audio\n\ncompono studio adulatio. Uredo deleo coniuratio traho patior."
},
{
"number": "4.4",
"title": "productize: Voluptas aliquam tabella tendo absorbeo perspiciatis tamquam. Omnis conservo demoror\nbellum officia. Urbs capillus alii spoliatio sumo."
}
],
"title": "niches"
}
],
"version": "1.6"
}

Side-by-Side Comparison

Extracted

Ground Truth

{
"approver": {
"email": "Sigmund.Robel51@yahoo.com",
"name": "Kristopher Lowe",
"title": "Global Communications Officer"
},
"category": "policy",
"definitions": [
{
"definition": "Totidem inventore abstergo tot.",
"term": "functionalities"
},
{
"definition": "Cado stultus sto provident ducimus complectus.",
"term": "paradigms"
},
{
"definition": "Terminatio testimonium tener undique admitto consuasor natus.",
"term": "blockchains"
},
{
"definition": "Vergo ars decipio.",
"term": "technologies"
}
],
"department": "Electronics",
"documentId": "policy-001-en",
"effectiveDate": "2025-08-02",
"owner": {
"email": "Leonardo.Considine88@hotmail.com",
"name": "Teresa Effertz Jr.",
"title": "Global Factors Representative"
},
"policyName": "Travel \u0026 Expense",
"policyNumber": "POL-XVAT",
"purpose": "Catena vomica vado dolores eum solus. Tamisium uxor una curo ultio crustulum tolero. Decerno sulum tubineus caste conduco trans tumultus confero casus.",
"relatedPolicies": [],
"reviewDate": "2026-02-12",
"revisionHistory": [
{
"author": "Katherine Mosciski",
"date": "2025-08-02",
"description": "Initial release",
"version": "1.0"
}
],
"scope": "Ver curso ustulo confido tego arguo conculco bene dedecor. Talus clam theologus aedificium. Unus virtus viridis dapifer vilitas.",
"sections": [
{
"content": "Quaerat casus tricesimus cuius auctus aestas titulus. Velum aliquam cernuus statua officia tener vulgo. Nostrum vereor barba cerno quas.\nAccedo acidus libero unus comparo video aranea alter templum ulterius. Varietas coadunatio aperte paens. Ulciscor umbra id.",
"number": "1",
"title": "web services"
},
{
"content": "Arbitro aedificium supra. Similique solium arbor cruciamentum. Vociferor vestrum solitudo anser umquam ver ciminatio.\nAestivus vulgo templum praesentium eveniet adicio. Nobis venustas ceno quibusdam tenuis tutis sol utilis. Volutabrum vulgus decipio verbera uterque.",
"number": "2",
"title": "synergies"
},
{
"content": "Caput spiritus illo summisse vado cruciamentum maiores amaritudo summopere. Decretum vel paens aequitas decretum appositus ulterius officia recusandae bene. Tantum capillus pauper tolero calcar cunae valde.\nQuis numquam creo cena subvenio conforto vulticulus tunc tonsor. Voluptas ustilo cometes conitor amplus quisquam degusto. Tum sunt ait volutabrum vigor inflammatio maxime cur tamisium.",
"number": "3",
"title": "large language models"
},
{
"content": "Laborum amissio tracto debitis pecus confugo demergo adicio unde. Sto cultellus basium. Beatae titulus defessus ultra aeternus aegrotatio strues vester inflammatio.\nTametsi placeat est quam attero. Desidero ut accendo coerceo sub coruscus. Atque aranea coadunatio deprecator pecus coniuratio vehemens.",
"number": "4",
"subsections": [
{
"content": "Compono decumbo amplexus thorax auctus confero demo termes. Tripudio tergiversatio tribuo vel tunc cunctatio. Cupiditas abbas cunabula aequus rem culpa ab tamdiu tenetur.",
"number": "4.1",
"title": "deliver"
},
{
"content": "Aeternus tergo infit conatus vita reiciendis eveniet. Tondeo vigilo facere perferendis attollo. Toties summopere advenio adulatio solio tametsi cito porro contego universe.",
"number": "4.2",
"title": "orchestrate"
},
{
"content": "Deficio demergo triumphus unde adimpleo derideo coniecto baiulus vulariter. Assentator audio compono studio adulatio. Uredo deleo coniuratio traho patior.",
"number": "4.3",
"title": "gamify"
},
{
"content": "Voluptas aliquam tabella tendo absorbeo perspiciatis tamquam. Omnis conservo demoror bellum officia. Urbs capillus alii spoliatio sumo.",
"number": "4.4",
"title": "productize"
}
],
"title": "niches"
}
],
"templateVariant": "default",
"version": "1.6"
}

Field Analysis

Matched

Mismatched

Missing

Accuracy

75.5%

Missing 13

? owner.title expected "Global Factors Representative"
? relatedPolicies._length expected "0"
? sections[3].subsections[3].content expected "Voluptas aliquam tabella tendo absorbeo perspiciat..."
? sections[3].subsections[1].content expected "Aeternus tergo infit conatus vita reiciendis eveni..."
? revisionHistory._length expected "1"
? reviewDate expected "2026-02-12"
? revisionHistory[0].date expected "2025-08-02"
? approver.title expected "Global Communications Officer"
? revisionHistory[0].author expected "Katherine Mosciski"
? sections[3].subsections[2].content expected "Deficio demergo triumphus unde adimpleo derideo co..."
? sections[3].subsections[0].content expected "Compono decumbo amplexus thorax auctus confero dem..."
? revisionHistory[0].description expected "Initial release"
? revisionHistory[0].version expected "1.0"

Matched 40

✓ sections[3].subsections[0].title
✓ owner.name
✓ definitions[0].term
✓ approver.name
✓ sections._length
✓ definitions[3].term
✓ sections[0].content
✓ sections[3].title
✓ sections[3].subsections[2].title
✓ sections[3].subsections[3].number
✓ sections[0].title
✓ policyNumber
✓ scope
✓ sections[1].content
✓ sections[2].content
✓ sections[3].subsections[1].number
✓ definitions._length
✓ policyName
✓ sections[3].subsections[2].number
✓ sections[3].subsections[0].number
✓ effectiveDate
✓ purpose
✓ sections[0].number
✓ sections[3].subsections[1].title
✓ sections[1].number
✓ sections[2].number
✓ sections[3].content
✓ sections[3].number
✓ version
✓ sections[2].title
✓ department
✓ sections[3].subsections[3].title
✓ definitions[0].definition
✓ definitions[2].definition
✓ sections[1].title
✓ sections[3].subsections._length
✓ definitions[1].definition
✓ definitions[1].term
✓ definitions[2].term
✓ definitions[3].definition

Extracted Text from PDF

TRAVEL & EXPENSE
Policy Number: POL-XVAT
Version: 1.6
Effective Date: 2025-08-02
Department: Electronics
Owner: Teresa Effertz Jr.
Approver: Kristopher Lowe
Purpose
Catena vomica vado dolores eum solus. Tamisium uxor una curo ultio crustulum tolero. Decerno sulum tubineus
caste conduco trans tumultus confero casus.
Scope
Ver curso ustulo confido tego arguo conculco bene dedecor. Talus clam theologus aedificium. Unus virtus viridis
dapifer vilitas.
Definitions
functionalities: Totidem inventore abstergo tot.
paradigms: Cado stultus sto provident ducimus complectus.
blockchains: Terminatio testimonium tener undique admitto consuasor natus.
technologies: Vergo ars decipio.
Policy Content
1. web services
Quaerat casus tricesimus cuius auctus aestas titulus. Velum aliquam cernuus statua officia tener vulgo. Nostrum
vereor barba cerno quas. Accedo acidus libero unus comparo video aranea alter templum ulterius. Varietas
coadunatio aperte paens. Ulciscor umbra id.
2. synergies
Arbitro aedificium supra. Similique solium arbor cruciamentum. Vociferor vestrum solitudo anser umquam ver
ciminatio. Aestivus vulgo templum praesentium eveniet adicio. Nobis venustas ceno quibusdam tenuis tutis sol
utilis. Volutabrum vulgus decipio verbera uterque.
3. large language models
Caput spiritus illo summisse vado cruciamentum maiores amaritudo summopere. Decretum vel paens aequitas
decretum appositus ulterius officia recusandae bene. Tantum capillus pauper tolero calcar cunae valde. Quis
numquam creo cena subvenio conforto vulticulus tunc tonsor. Voluptas ustilo cometes conitor amplus quisquam
degusto. Tum sunt ait volutabrum vigor inflammatio maxime cur tamisium.
4. niches
Laborum amissio tracto debitis pecus confugo demergo adicio unde. Sto cultellus basium. Beatae titulus
defessus ultra aeternus aegrotatio strues vester inflammatio. Tametsi placeat est quam attero. Desidero ut
accendo coerceo sub coruscus. Atque aranea coadunatio deprecator pecus coniuratio vehemens.
4.1 deliver: Compono decumbo amplexus thorax auctus confero demo termes. Tripudio tergiversatio tribuo vel
tunc cunctatio. Cupiditas abbas cunabula aequus rem culpa ab tamdiu tenetur.
4.2 orchestrate: Aeternus tergo infit conatus vita reiciendis eveniet. Tondeo vigilo facere perferendis attollo.
Toties summopere advenio adulatio solio tametsi cito porro contego universe.
4.3 gamify: Deficio demergo triumphus unde adimpleo derideo coniecto baiulus vulariter. Assentator audio

compono studio adulatio. Uredo deleo coniuratio traho patior.
4.4 productize: Voluptas aliquam tabella tendo absorbeo perspiciatis tamquam. Omnis conservo demoror
bellum officia. Urbs capillus alii spoliatio sumo.

System Prompt

You are a precise document data extraction expert. Your task is to extract structured data from policy documents.

## Extraction Guidelines

Extract policy document data including:
- Policy name, number, version
- Effective date and review date
- Department, approver, owner
- Scope and purpose
- Sections (number, title, content)
- Definitions and related policies

## Important Rules

1. **Dates**: Always use ISO format (YYYY-MM-DD) for full dates, HH:MM for times
2. **Currency**: Use 3-letter ISO 4217 codes (EUR, USD, GBP, etc.)
3. **Missing optional fields**: Omit them entirely, don't use null or empty strings
4. **Required fields**: Make your best effort to extract; if truly not present, use reasonable placeholder
5. **Numbers**: Extract as numeric values, not strings (except for identifiers like document numbers)
6. **Arrays**: Always return arrays even if only one item exists
7. **Text content**: Preserve important content accurately but you may summarize very long passages
8. **Names**: Extract full names as they appear in the document

Respond with a JSON object containing the extracted data. Be precise and extract only what is explicitly stated in the document.

User Prompt

Please extract all structured data from this policy document:

---
TRAVEL & EXPENSE
Policy Number: POL-XVAT
Version: 1.6
Effective Date: 2025-08-02
Department: Electronics
Owner: Teresa Effertz Jr.
Approver: Kristopher Lowe
Purpose
Catena vomica vado dolores eum solus. Tamisium uxor una curo ultio crustulum tolero. Decerno sulum tubineus
caste conduco trans tumultus confero casus.
Scope
Ver curso ustulo confido tego arguo conculco bene dedecor. Talus clam theologus aedificium. Unus virtus viridis
dapifer vilitas.
Definitions
functionalities: Totidem inventore abstergo tot.
paradigms: Cado stultus sto provident ducimus complectus.
blockchains: Terminatio testimonium tener undique admitto consuasor natus.
technologies: Vergo ars decipio.
Policy Content
1. web services
Quaerat casus tricesimus cuius auctus aestas titulus. Velum aliquam cernuus statua officia tener vulgo. Nostrum
vereor barba cerno quas. Accedo acidus libero unus comparo video aranea alter templum ulterius. Varietas
coadunatio aperte paens. Ulciscor umbra id.
2. synergies
Arbitro aedificium supra. Similique solium arbor cruciamentum. Vociferor vestrum solitudo anser umquam ver
ciminatio. Aestivus vulgo templum praesentium eveniet adicio. Nobis venustas ceno quibusdam tenuis tutis sol
utilis. Volutabrum vulgus decipio verbera uterque.
3. large language models
Caput spiritus illo summisse vado cruciamentum maiores amaritudo summopere. Decretum vel paens aequitas
decretum appositus ulterius officia recusandae bene. Tantum capillus pauper tolero calcar cunae valde. Quis
numquam creo cena subvenio conforto vulticulus tunc tonsor. Voluptas ustilo cometes conitor amplus quisquam
degusto. Tum sunt ait volutabrum vigor inflammatio maxime cur tamisium.
4. niches
Laborum amissio tracto debitis pecus confugo demergo adicio unde. Sto cultellus basium. Beatae titulus
defessus ultra aeternus aegrotatio strues vester inflammatio. Tametsi placeat est quam attero. Desidero ut
accendo coerceo sub coruscus. Atque aranea coadunatio deprecator pecus coniuratio vehemens.
4.1 deliver: Compono decumbo amplexus thorax auctus confero demo termes. Tripudio tergiversatio tribuo vel
tunc cunctatio. Cupiditas abbas cunabula aequus rem culpa ab tamdiu tenetur.
4.2 orchestrate: Aeternus tergo infit conatus vita reiciendis eveniet. Tondeo vigilo facere perferendis attollo.
Toties summopere advenio adulatio solio tametsi cito porro contego universe.
4.3 gamify: Deficio demergo triumphus unde adimpleo derideo coniecto baiulus vulariter. Assentator audio

Extract the data as JSON according to the schema.

Raw LLM Response

{
"policyName": "TRAVEL & EXPENSE",
"effectiveDate": "2025-08-02",
"scope": "Ver curso ustulo confido tego arguo conculco bene dedecor. Talus clam theologus aedificium. Unus virtus viridis\ndapifer vilitas.",
"purpose": "Catena vomica vado dolores eum solus. Tamisium uxor una curo ultio crustulum tolero. Decerno sulum tubineus\ncaste conduco trans tumultus confero casus.",
"approver": {
"name": "Kristopher Lowe"
},
"definitions": [
{
"term": "functionalities",
"definition": "Totidem inventore abstergo tot."
},
{
"term": "paradigms",
"definition": "Cado stultus sto provident ducimus complectus."
},
{
"term": "blockchains",
"definition": "Terminatio testimonium tener undique admitto consuasor natus."
},
{
"term": "technologies",
"definition": "Vergo ars decipio."
}
],
"department": "Electronics",
"owner": {
"name": "Teresa Effertz Jr."
},
"policyNumber": "POL-XVAT",
"sections": [
{
"number": "1",
"title": "web services",
"content": "Quaerat casus tricesimus cuius auctus aestas titulus. Velum aliquam cernuus statua officia tener vulgo. Nostrum\nvereor barba cerno quas. Accedo acidus libero unus comparo video aranea alter templum ulterius. Varietas\ncoadunatio aperte paens. Ulciscor umbra id."
},
{
"number": "2",
"title": "synergies",
"content": "Arbitro aedificium supra. Similique solium arbor cruciamentum. Vociferor vestrum solitudo anser umquam ver\nciminatio. Aestivus vulgo templum praesentium eveniet adicio. Nobis venustas ceno quibusdam tenuis tutis sol\nutilis. Volutabrum vulgus decipio verbera uterque."
},
{
"number": "3",
"title": "large language models",
"content": "Caput spiritus illo summisse vado cruciamentum maiores amaritudo summopere. Decretum vel paens aequitas\ndecretum appositus ulterius officia recusandae bene. Tantum capillus pauper tolero calcar cunae valde. Quis\nnumquam creo cena subvenio conforto vulticulus tunc tonsor. Voluptas ustilo cometes conitor amplus quisquam\ndegusto. Tum sunt ait volutabrum vigor inflammatio maxime cur tamisium."
},
{
"number": "4",
"title": "niches",
"content": "Laborum amissio tracto debitis pecus confugo demergo adicio unde. Sto cultellus basium. Beatae titulus\ndefessus ultra aeternus aegrotatio strues vester inflammatio. Tametsi placeat est quam attero. Desidero ut\naccendo coerceo sub coruscus. Atque aranea coadunatio deprecator pecus coniuratio vehemens.",
"subsections": [
{
"number": "4.1",
"title": "deliver: Compono decumbo amplexus thorax auctus confero demo termes. Tripudio tergiversatio tribuo vel\ntunc cunctatio. Cupiditas abbas cunabula aequus rem culpa ab tamdiu tenetur."
},
{
"number": "4.2",
"title": "orchestrate: Aeternus tergo infit conatus vita reiciendis eveniet. Tondeo vigilo facere perferendis attollo.\nToties summopere advenio adulatio solio tametsi cito porro contego universe."
},
{
"number": "4.3",
"title": "gamify: Deficio demergo triumphus unde adimpleo derideo coniecto baiulus vulariter. Assentator audio\n\ncompono studio adulatio. Uredo deleo coniuratio traho patior."
},
{
"number": "4.4",
"title": "productize: Voluptas aliquam tabella tendo absorbeo perspiciatis tamquam. Omnis conservo demoror\nbellum officia. Urbs capillus alii spoliatio sumo."
}
]
}
],
"version": "1.6"
}

JSON Schema (Structured Output)

This schema is passed to the LLM via ResponseSchema to enforce structured JSON output.

{
  "example": {
    "approver": {
      "name": "David Wilson",
      "title": "Chief Information Security Officer"
    },
    "definitions": [
      {
        "definition": "Personally Identifiable Information - any data that could identify a specific individual.",
        "term": "PII"
      }
    ],
    "department": "Information Technology",
    "effectiveDate": "2024-01-01",
    "owner": {
      "name": "Emily Taylor",
      "title": "IT Security Manager"
    },
    "policyName": "Information Security Policy",
    "policyNumber": "POL-SEC-001",
    "purpose": "To establish guidelines for protecting company information assets and ensuring data security.",
    "relatedPolicies": [
      "Data Classification Policy",
      "Acceptable Use Policy"
    ],
    "reviewDate": "2025-01-01",
    "scope": "This policy applies to all employees, contractors, and third parties with access to company systems.",
    "sections": [
      {
        "content": "All passwords must be at least 12 characters and include uppercase, lowercase, numbers, and symbols.",
        "number": "1",
        "title": "Password Requirements"
      },
      {
        "content": "Access to systems shall be granted on a need-to-know basis following the principle of least privilege.",
        "number": "2",
        "title": "Access Control"
      }
    ],
    "version": "2.0"
  },
  "properties": {
    "approver": {
      "properties": {
        "email": {
          "description": "Email address",
          "type": "STRING"
        },
        "name": {
          "description": "Full name of the person",
          "type": "STRING"
        },
        "title": {
          "description": "Job title or role",
          "type": "STRING"
        }
      },
      "required": [
        "name"
      ],
      "type": "OBJECT"
    },
    "definitions": {
      "items": {
        "properties": {
          "definition": {
            "type": "STRING"
          },
          "term": {
            "type": "STRING"
          }
        },
        "required": [
          "term",
          "definition"
        ],
        "type": "OBJECT"
      },
      "type": "ARRAY"
    },
    "department": {
      "type": "STRING"
    },
    "effectiveDate": {
      "description": "Date in YYYY-MM-DD format",
      "type": "STRING"
    },
    "owner": {
      "properties": {
        "email": {
          "description": "Email address",
          "type": "STRING"
        },
        "name": {
          "description": "Full name of the person",
          "type": "STRING"
        },
        "title": {
          "description": "Job title or role",
          "type": "STRING"
        }
      },
      "required": [
        "name"
      ],
      "type": "OBJECT"
    },
    "policyName": {
      "type": "STRING"
    },
    "policyNumber": {
      "type": "STRING"
    },
    "purpose": {
      "type": "STRING"
    },
    "relatedPolicies": {
      "items": {
        "type": "STRING"
      },
      "type": "ARRAY"
    },
    "reviewDate": {
      "description": "Date in YYYY-MM-DD format",
      "type": "STRING"
    },
    "revisionHistory": {
      "items": {
        "properties": {
          "author": {
            "type": "STRING"
          },
          "date": {
            "type": "STRING"
          },
          "description": {
            "type": "STRING"
          },
          "version": {
            "type": "STRING"
          }
        },
        "type": "OBJECT"
      },
      "type": "ARRAY"
    },
    "scope": {
      "type": "STRING"
    },
    "sections": {
      "items": {
        "properties": {
          "content": {
            "type": "STRING"
          },
          "number": {
            "type": "STRING"
          },
          "subsections": {
            "items": {
              "properties": {
                "content": {
                  "type": "STRING"
                },
                "number": {
                  "type": "STRING"
                },
                "title": {
                  "type": "STRING"
                }
              },
              "type": "OBJECT"
            },
            "type": "ARRAY"
          },
          "title": {
            "type": "STRING"
          }
        },
        "required": [
          "number",
          "title",
          "content"
        ],
        "type": "OBJECT"
      },
      "type": "ARRAY"
    },
    "version": {
      "type": "STRING"
    }
  },
  "required": [
    "policyName",
    "effectiveDate",
    "scope",
    "purpose"
  ],
  "type": "OBJECT"
}

policy-001-en extraction

Extracted

Ground Truth

Missing 13

Matched 40