Zahid Ahmed's avatar: a cursor types the monogram <ZA/> like code
Software Developer · AI Evaluation & Benchmark Design

Zahid Ahmed

Building software, and testing where AI breaks.

Full-stack developer with an MCA and 3+ years of dedicated Python development. As a Handshake AI Fellow, I design software tasks, reference solutions, and automated tests that train and evaluate frontier AI coding models. I build in Python, .NET, and SQL, and I write about it.

📍 Malegaon, Maharashtra, India  ·  ✉️ zahid23saim@gmail.com

About

I’m a software developer and AI-evaluation specialist with a Master of Computer Applications and 15+ years across software engineering, database work, data quality, and research. I’ve built full-stack web applications and backend systems in Python, .NET, C#, and Java, and tuned complex SQL and Oracle PL/SQL workloads for performance.

Today I’m a Handshake AI Fellow, creating challenging software tasks that train and evaluate frontier AI coding models — designing the problem, setting up a reproducible environment, writing the reference solution, and building tests that accept every valid solution while rejecting subtly broken ones. Before that, I evaluated multilingual LLM and speech output at Appen. It sits right where software engineering meets AI quality, and it’s the work I find most interesting.

My 10-second brand intro, made with Gemini: first the banner, then a video from it. The first take garbled “tested” into “testea”, so I locked the camera, regenerated it, and checked the text frame by frame.

Skills

AI Evaluation
AI Coding-Task DesignAutomated Test DesignAI Agent Failure AnalysisLLM Output EvaluationFactuality & STEM AuditingTTS Quality (MOS)Data Annotation
Languages
PythonC#JavaSQLPL/SQLJavaScriptBashCC++
Web & Frameworks
.NET / .NET CoreASP.NET CoreEntity FrameworkMVCHTMLCSS
Tools & Platforms
DockerGit & GitHubLinux CLIuvpytestxUnitCloudflare WorkersSlack APIMS Excel
Databases
Oracle (DBA & PL/SQL)MySQLMariaDBStored ProceduresQuery Optimization
Practices
OOP & System DesignAutomated TestingDebuggingQuality AssuranceTechnical Writing

Experience

AI Fellow

Jul 2026 – Present
Handshake AI
  • Create challenging, real-world software engineering tasks used to train and evaluate frontier AI coding models.
  • Build each task end to end: a reproducible environment, a working reference solution, and automated tests that judge only the final result, so every valid solution passes and subtly broken ones fail.
  • Write clear, unambiguous task instructions and harden tests against shortcuts and hard-coded answers.
  • Run AI agents on the tasks, analyze where and why they fail, and refine each task until it is both solvable and genuinely difficult; revise work through automated quality checks and expert review.

AI Data Contributor & Evaluator

May 2025 – Jun 2026
Appen
  • Evaluated LLM-generated responses across multilingual datasets (English, Hindi, Tamil, Marathi), writing detailed feedback to sharpen linguistic nuance and technical precision.
  • Ran Python-assisted factuality and quality checks on STEM-focused AI queries and classified educational content.
  • Rated AI audio dubbing and text-to-speech (TTS) output on Mean Opinion Score (MOS) scales for naturalness, prosody, and translation accuracy.

Freelance Translator & Transcriptionist

May 2024 – Apr 2025
Self-employed
  • Delivered verbatim transcription and technical/general translation across English, Hindi, Tamil, and Marathi under strict notation guidelines.
  • Audited audio against transcripts to keep every deliverable accurate, consistent, and client-ready.

Software Developer

2021 – 2023
Emsys Solutions Pvt Ltd
  • Designed, built, and maintained custom software for vehicle showrooms and dealerships, streamlining sales and day-to-day operational workflows.
  • Developed web applications and backend services with Python, .NET Core, C#, Entity Framework, MVC, and JavaScript.
  • Wrote and optimized complex SQL, MySQL, and MariaDB stored procedures for fast, reliable data access.
  • Applied OOP principles to improve application architecture, scalability, and maintainability.

Quality Analyst

Jul 2018 – 2024
Datamatics Business Solutions Ltd
  • Analyzed client requirements to produce accurate effort estimates, resource plans, and turnaround-time (TAT) commitments.
  • Maintained project logs and resource-utilization reports to balance workload and improve team efficiency.

Senior Research Associate

Apr 2016 – Jun 2018
Datamatics Business Solutions Ltd
  • Led secondary-research initiatives, validating entity data with advanced web-search techniques.
  • Coordinated workflow and task allocation to meet client deadlines consistently.

Research Associate

Apr 2009 – Apr 2015
Datamatics Business Solutions Ltd
  • Ran quality-control checks on research datasets and trained new hires on process and Excel data formatting.

Projects & Open Source

Block & Bell live

JavaScript · Cloudflare Workers · Durable Objects · WebSockets

A real-time railway-signaling game for 2–4 players where each player’s working orders appear only on a neighbor’s screen, so they have to talk to get the trains through. A server-authoritative Durable Objects backend sends each seat only its own view; a seeded generator solves every shift before printing it (verified on 600 generated layouts), and a capacity fix raised simulated completion from 2/400 to 398/400 nights.

Word Limit Checker Slack app

JavaScript · Slack API · Cloudflare Workers

A Slack app whose /wordcount slash command posts a draft’s word count and how far it is over or under a limit. Built for least privilege: it replies in the command’s own response, so it needs only the commands scope and stores no bot token, and it verifies every request with Slack’s signing secret (HMAC-SHA256, 5-minute replay window).

llm-eval-harness tested

Python · pytest · stdlib

A dependency-free harness for scoring LLM answers against a gold set, with per-question match rules (exact / contains / numeric), gold-file validation, actionable failure output, and a CI-friendly exit code.

aspnet-minimal-api 7/7 tests

C# · ASP.NET Core · .NET 8 · xUnit

A compact task-tracker Web API in a single file — full CRUD with validation and correct status codes — plus integration tests that boot the app in memory and exercise the real endpoints.

plsql-bulk-examples

Oracle PL/SQL

Runnable examples that turn a slow row-by-row load into fast batched processing with BULK COLLECT and FORALL, plus SAVE EXCEPTIONS error handling — demonstrated on a 200k-row table.

Smart Maintenance Portal

Java · Python · MySQL · HTML/CSS

A full-stack web portal, built during earlier software-development work, for submitting municipal complaints and tracking their resolution — with an admin dashboard that routes each complaint to the right department and monitors real-time status. Full-stack build across backend, database, and UI.

Technical Writing

Catch LLM Regressions Before Your Users Do — a Tiny CI Gate for LLM OutputTutorial · LLM
Automating LLM Answer Evaluation with a Small Python Scoring ScriptTutorial · Python
Speeding Up a Slow PL/SQL Routine with BULK COLLECT and FORALLTutorial · Oracle
Building a Tested ASP.NET Core Minimal API in One FileTutorial · .NET
What I Learned Evaluating LLMs Across Four LanguagesOpinion · AI

More at dev.to/zahid23saim

Education & Credentials

Master of Computer Applications (MCA)
Savitribai Phule Pune University · 2009–2012
B.Sc. in Information Technology
Akbar Peerbhoy College · 2005
Oracle DBA & PL/SQL Certification
Karrox Technology · 2007

Languages: English, Hindi, Tamil, Marathi — professional fluency (native / near-native).

Contact

Open to remote, project-based software and AI-evaluation work.