Oneleet Vendor Supply Chain Analyst at Oneleet responsible for verifying AI-generated vendor security research and maintaining a shared vendor library. Ensures accuracy and reliability of vendor security posture scores.
Responsibilities
Oneleet helps customers understand the security posture of the vendors they use without repeating the same research for every company. Our shared vendor library brings together findings from public sources so customers can make informed decisions faster.
As our Vendor Supply Chain Analyst, you’ll help build and maintain that library. Your core responsibility is verifying AI-generated research: checking findings against saved sources, resolving gaps, and making sure the evidence supports the conclusions. Engineering owns the AI research pipeline; you’ll provide the feedback that makes its output more accurate and useful.
Each shared vendor record has a security posture score. Customer-specific risk scores are calculated separately using each customer’s exposure to that vendor. Your work ensures the underlying vendor research is reliable.
Preliminary research results appear immediately. Human verification follows, with a target turnaround of 1-2 days. The pipeline automatically re-researches vendors every 90 days and routes significant changes for human review.
You’ll help work through an initial backlog of approximately 500–600 vendors, prioritizing those used by the most customers. You’ll also help establish how we measure research accuracy and compare computed scores with existing customer-assigned ratings. This is an opportunity to shape how Oneleet evaluates vendor security at scale.
Verify vendor research. Check AI-generated findings against saved sources, prioritizing vendors by how many customers use them. Correct unsupported claims and distinguish confirmed findings from missing or inconclusive evidence.
Build and maintain the vendor library. Research new SaaS vendors, resolve incomplete records, and review significant changes flagged by the pipeline, including breaches and changes to security practices.
Resolve source-access gaps. When the pipeline cannot fetch a page or encounters a login barrier, find an accessible source or manually upload an available document.
Confirm public security claims. Verify evidence for criteria such as SSO availability, published DPAs, subprocessor lists, and whether a SOC 2 report exists.
Measure accuracy and calibrate scoring. Evaluate research accuracy during the proof of concept and beyond. Compare computed scores with existing customer-assigned ratings, investigate differences, and recommend adjustments where the evidence supports them.
Improve research quality. Document recurring errors, missed evidence, and ambiguous results, then give engineering actionable feedback to improve the AI pipeline.
Recommend criteria updates. Identify gaps or unclear definitions in the evaluation criteria and propose changes as vendor practices and security expectations evolve.
Qualification
Experience measuring research accuracyA background in third-party riskAt OneleetHere’s what makes us specialWe value impact over titles
Preferred
Experience evaluating AI-generated research or designing human review processes.
Experience measuring research accuracy, calibrating scoring systems, or building quality assurance processes.
A background in third-party risk, compliance, or security research.
Experience helping an early-stage startup grow from Seed to Series A or beyond.
Scripting or automation skills that help you analyze results or make verification more efficient.
At Oneleet, you’ll join a tight-knit team of rebels redefining the cybersecurity industry. We move fast, own our work, and challenge outdated models to make security effortless and effective for companies.
Here’s what makes us special:
We value impact over titles, autonomy over micromanagement, and clarity over jargon.
