SanayKamay: Video skill rubric coach and portfolio builder for informal workers taking TESDA NC II exams

Problem Statement

Millions of skilled Filipino workers in the informal sector—neighborhood motorcycle mechanics (mekaniko sa kanto), barangay welders, house-wiring electricians, plumbers, and home caregivers—have years of hands-on experience but earn below minimum wage because they lack a formal TESDA National Certificate (NC II) or Certificate of Competency (COC). Under TESDA’s Recognition of Prior Learning (RPL) program, experienced workers can take the practical assessment directly without sitting through months of school. However, many informal workers fail the practical exam on their first attempt—losing their ₱1,000 to ₱2,500 assessment fee and a full day’s wage—not because they lack trade skill, but because they skip formal Occupational Safety and Health (OSH) sequence steps, PPE checks, or tool housekeeping rules that TESDA assessors strictly grade on.

Proposed Solution

SanayKamay is a pocket TESDA assessment coach and verified video portfolio builder for informal Filipino tradespeople:

1. 90-Second Practical Mock Assessment: The worker selects their target TESDA qualification (for example, Electrical Installation and Maintenance NC II, Shielded Metal Arc Welding NC II, Motorcycle/Small Engine Servicing NC II, or Caregiving NC II) and props up their phone to record a 90-second video performing a standard competency unit.
2. Action Quality Assessment & Safety Rubric Grader: SanayKamay tracks the worker’s hands, body posture, Personal Protective Equipment (PPE), and tools across time, grading the video against the official TESDA Self-Assessment Guide and Competency Assessment Rubric. It flags exact procedural deductions before the worker pays for the real exam (for example: “Nakita kong maayos ang pagkakabit mo ng circuit breaker, pero nakalimutan mong gumamit ng multitester para i-verify na zero voltage bago hawakan ang wire, at walang safety goggles—automatic fail ito sa TESDA OSH rubric”).
3. Verified Video Skill Passport: Once the worker passes all rubric steps in practice mode, SanayKamay compiles a tamper-evident, timestamped 60-second Video Skill Reel paired with their TESDA Self-Assessment checklist and matches them to the nearest accredited TESDA assessment center offering free TWSP/STEP assessment vouchers and local hardware/contractor job openings.

Target Market

• Primary users: Informal sector tradespeople (welders, electricians, mechanics, carpenters, plumbers, domestic and elderly caregivers), out-of-school youth, and returning displaced OFWs seeking TESDA RPL certification.
• Public-sector and industry buyers: TESDA Provincial and District Offices, LGU Public Employment Service Offices (PESO), hardware and construction contractor associations (PCA), and local service marketplaces.
• Community benefit: Turns decades of unrecognized diskarte and street-level trade mastery into formal TESDA credentials that unlock higher-paying formal jobs and overseas placement.

How AI Is Used

• PPE and tool state object detection (YOLOv8): Verifies mandatory safety gear (insulated gloves, welding mask, safety glasses, closed shoes) and proper tool selection at the start, middle, and end of the task.
• Temporal action segmentation and Action Quality Assessment (AQA): Segments the continuous video into discrete procedural sub-tasks (Preparation $\rightarrow$ Safety Lockout $\rightarrow$ Execution $\rightarrow$ Testing $\rightarrow$ 5S Housekeeping) and checks whether any mandatory precondition step was performed out of order.
• Tagalog and Bisaya coaching feedback: Generates encouraging, timestamp-linked voice and visual feedback showing the exact 3-second clip where a safety or sequence deduction occurred.

Community & Ecosystem Integration

• Grounded in official TESDA Training Regulations (TR) & Self-Assessment Guides: Uses the exact Performance Criteria and Evidence Plan checklists published by TESDA for top NC II qualifications.
• Unlocks free TESDA assessment vouchers: Connects pre-assessed workers directly to PESO and TESDA district scholarships so they don’t risk out-of-pocket exam fees unprepared.
• Proof-of-skill for workers without resumes: Gives workers who have never written a formal CV a verified 60-second video demonstration of their craft to show local contractors.

Demo Scenario (3 minutes for judges)

1. Set a standard electrical wiring board (breaker, switch, bulb socket, multitester, insulated gloves, goggles) on the judge table for TESDA Electrical Installation and Maintenance (EIM) NC II.
2. Attempt 1 (Typical Informal Habit): A teammate wires the switch quickly and cleanly in 35 seconds, but works bare-handed without goggles and skips testing the line with the multitester before touching the terminal.
3. SanayKamay analyzes the clip in 6 seconds and scores it: Technical Execution: 95% | OSH & Sequence Rubric: NOT YET COMPETENT. It highlights the exact timestamp (0:12) where the bare hand touched the terminal without a multitester zero-voltage check and explains the fix in Tagalog.
4. Attempt 2 (TESDA-Ready): The teammate puts on PPE, performs the multitester check first, wires the switch, and cleans the work area (5S). SanayKamay marks all 5 rubric bars green (COMPETENT — Ready for TESDA NC II Assessment) and generates their shareable Video Skill Passport QR code.

30-Hour Build Plan

Suggested stack: Python FastAPI, Ultralytics YOLOv8 + MediaPipe Holistic, Gemini Multimodal API (frame-sequence temporal rubric verification), PostgreSQL, Next.js PWA. Public data / APIs: TESDA Training Regulations (TR) and Competency Assessment Tools (CATs) public documents, TESDA Registry of Accredited Assessment Centers, Ego4D / Assembly101 procedural action datasets.

Research & Literature References

1. Paritosh Parmar and Brendan Tran Morris, “What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessment,” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 304-313, 2019. DOI: 10.1109/CVPR.2019.00039
   • How SanayKamay uses this study: Applies the study’s multitask Action Quality Assessment (AQA) framework—jointly recognizing what sub-actions were performed and scoring execution quality against a structured judging rubric—to vocational trade tasks.

Risks & Privacy Notes

• Physical safety during practice: SanayKamay explicitly requires all electrical and mechanical practice videos to be performed on unplugged, de-energized training boards or low-voltage simulation rigs.
• Pre-assessment coach, not official certification: Clearly informs users that official NC II certificates are issued only by TESDA-accredited human competency assessors at designated assessment centers.
• Strict 30-hour feasibility constraint: Unconstrained video Action Quality Assessment on real welding arcs or wiring boards is highly sensitive to camera angle and occlusion, limiting a 30-hour prototype to a single fixed-camera task.

AI Use Disclosure (draft)

SanayKamay uses YOLOv8 and MediaPipe for PPE, tool, and hand-interaction detection, and a multimodal sequence model grounded in TESDA Training Regulations for procedural Action Quality Assessment. AI coding assistants helped build the video timeline player and skill passport layout. All competency checklists were verified against public TESDA standards.

Rubric Scoring