匠人学院 JR Academy
  • Position

    Where am I now, and where should I go?

    A few questions show how much AI affects your current role and where the openings are. Free, no sign-up.

    Check where I stand, free

    How AI changes careers

    Will AI replace my job?AI impact and transition paths for common careersNew jobs in the AI eraWhat they do, what they need, how to move inAI impact checkA few questions on the risks and openings in your role

    Self-checks

    Readiness assessmentHow ready you are for AI Engineer interviewsCareer personality testDirections that suit how you workCareer planningAnswer a few questions to see careers that may fitReturning to China checkJob prospects in China by school, major and graduation date
  • Skill

    Not sure which AI skills to learn?

    Start with a free learning path that goes from basics to hands-on work; move to a bootcamp or a mentor when you want structure.

    Start a free learning path

    Free learning paths

    Vibe CodingWrite code with AI, no background neededAI for office workDocuments, spreadsheets and reports with AIPrompt MasterHow to state what you need clearlyAI EngineerRAG, agents and MCP in practiceAI data analysisQueries, cleaning and reports with AIAll learning paths →

    Bootcamps and courses

    All bootcampsFilter by career path, level and formatAI Engineer BootcampEngineering bootcamp from LLM apps to agentsAI Coding for everyoneHands-on AI coding for non-technical learnersAI Workflow BootcampAI workflows for working professionalsInstructorsPractising engineers and industry mentorsAll courses →

    Practice and reference

    Interactive labsPrompt, frontend, Python and AWS practice onlineLearning roadmapsOne map of what to learn in which orderCheat sheetsQuick references for languages and toolsWikiAI tools and concepts explainedVideosTalks, open classes and student storiesFree resources →
  • Evidence

    What will convince an employer?

    Certifications, projects, team work and competition entries, collected into one portfolio.

    See the portfolio

    Certifications

    Cert Master · all certificationsPrep and mock exams for AWS, Azure, GCP, Claude and moreAWS SAA-C03Entry certification for cloud architectsAzure AI-102Microsoft AI engineer certificationClaude certificationsAnthropic Claude certification seriesMock examsTimed practice in the real exam interfaceAll certifications →

    Projects and team work

    P3 team projectsBuild a project with real teammates in a simulated team workflowP3 project experienceThe parts of a P3 project that go on your resumeDemo DayProject showcaseP3 certificatesProof once a project is completeAll of P3 →

    Competitions and work

    HackathonsBuild something against the clockSubmit your workAdd your project to the showcaseCareerOS portfolioDo tasks in the desktop app; your results become portfolio pieces
    Cert MasterBrowser extension, app and mini programScreenshot a question for analysis and practise anywhereAbout Cert Master
  • Connect

    How do I get myself in front of employers?

    Resume, interviews, referrals and mentors. See how far you are from the target role first, then decide what to fix.

    Start with Job Hunter

    Resume and openings

    Job HunterAI job search workspace: resume, roles, applicationsAI resumeRewrite your resume against a job descriptionReferralsRoles shared by students and mentorsOpportunitiesInternships, projects and collaborationsOffer boardOffers students have received

    Interviews

    AI mock interviewPractise by text or voice and see the gapsInterview centreQuestions by company and roleInterview storiesReal interview experiencesSystem Design handbookPrepare for system design interviewsAll interview prep →

    Mentors

    1:1 mentorsBook AI, career and technical mentors by the hourGroup tutoringShare a tutor with a few others and pay less eachCareer coachingResume, interview and direction packagesBecome a mentorJoin the JR Academy mentor team
    Job Hunter desktopOne workspace for the whole job searchOrganise real experience and refine resume versions for target roles on macOS or Windows.About Job Hunter
BusinessMembershipDownload CareerOS
匠人学院 JR Academy

Follow Us

linkedinfacebooktwitterinstagramyoutube

We Accept

/image/layout/pay-paypal.png/image/layout/pay-visa.png/image/layout/pay-master-card.png/image/layout/pay-airwallex.png/image/layout/pay-alipay.png
EN
Products

CareerOS and tools

  • CareerOS
  • Cert Master
  • Job Hunter
  • Job Hunter web
  • Job Hunter report
  • Job Hunter desktop download
  • My job search reports
  • Buy report credits
  • Job Hunter billing
  • AI Toolbox
  • AI Skill Marketplace

Membership and courses

  • Membership
  • AI membership
  • AI Engineer VIP
  • Bootcamps
  • Training Camp
  • Kanban learning
  • AI Builder course
  • MCP course
  • NotebookLM workshop
  • Business Analyst course
  • Web Full-Stack Bootcamp
  • DevOps Bootcamp
  • Data Engineering Bootcamp
  • Data Analysis Bootcamp
  • Coding for Beginners
  • Algorithm Bootcamp

Career services

  • 1:1 coaching
  • Career coaching
  • BA & PM Internship
  • Data Science Internship
  • Data Analysis Internship
  • Marketing Internship
  • Resume Review
  • Interview Coaching
  • Job Application Service
  • Job Monitoring
  • LinkedIn Management
  • LinkedIn Networking
Library

Learning paths

  • All Learning Paths
  • AI Engineer
  • Context Engineering
  • Vibe Coding
  • Prompt Master
  • AI Builder
  • AI Product Manager
  • Python Basics
  • AI Productivity
  • AI Data Analysis
  • AI Finance
  • AI Content Creation
  • AI Image Creation
  • Frontend Development
  • Hermes Agent
  • OpenClaw Local Agent

Interactive labs

  • Prompt Lab
  • Frontend Lab
  • JavaScript Lab
  • Python Lab
  • AWS Lab
  • Azure Lab
  • LLM Lab
  • Git Lab

Reference and guides

  • Wiki
  • Learning wiki
  • Cheat sheets
  • Roadmaps
  • AI roadmaps
  • Videos
  • Blog
  • Interview handbook
  • Mock exams
  • Free resources

Cities

  • Sydney
  • Melbourne
  • Brisbane
  • Adelaide
  • Singapore
  • Kuala Lumpur
  • London
  • New York
  • San Francisco
  • Los Angeles
  • Seattle
  • Toronto
  • Vancouver

Immigration

  • Australia Immigration
  • Skilled Visa 189/190/491
  • Employer Sponsored 482/186/494
  • Business Visa 188/888
  • UK Immigration
  • US Immigration
  • Canada Immigration
  • Singapore immigration
  • Malaysia immigration
Business

For business

  • AI for Business
  • Business portal sign-in
  • Corporate Training
  • Internship Partnership
  • Recruitment Partnership
  • Enterprise (EN)

Metatree AI Lab

  • Metatree AI Lab (Chinese)
  • AI solutions (Chinese)
  • Digital employees (Chinese)
  • Case studies (Chinese)
  • Metatree AI Lab
  • AI services
  • Digital employees
  • Case studies

AI education for kids

  • Airbotix — AI Coding for Kids
  • AU Family Resource Hub
  • NAPLAN Report Guide
  • My School Data Guide
  • Sydney Private School Fees 2026
  • Kids Coding Programs
About

Company

  • About Us
  • Our Mentors
  • Become a Mentor
  • News & Blog
  • Metaverse Classroom
  • JR Careers
  • JR Store J3.Club
  • Contact Us

Help and policies

  • FAQs
  • Terms & Conditions
  • Privacy Policy
  • Cancellation & Refund Policy
  • Site map

Contact

  • hello@jiangren.com.au
  • 0421-672-555

Offices

Level 10b, 144 Edward Street, Brisbane CBD (Headquarter)
Level 2, 171 La Trobe St, Melbourne VIC 3000
45A13, Block B, Oriental Hope Tianxiang Plaza, 500 Tianfu Avenue Middle Section, Wuhou District, Chengdu, Sichuan, China
Business Hub, 155 Waymouth St, Adelaide SA 5000

Disclaimer

footer-disclaimerfooter-disclaimer

JR Academy acknowledges Traditional Owners of Country throughout Australia and recognises the continuing connection to lands, waters and communities. We pay our respect to Aboriginal and Torres Strait Islander cultures; and to Elders past and present. Aboriginal and Torres Strait Islander peoples should be aware that this website may contain images or names of people who have since passed away.

All content on the JR Academy website, including course materials, logos, and information provided, is protected under Australian intellectual property laws. Unauthorized use, sale, distribution, reproduction, or modification is strictly prohibited. Violations may result in legal action. By accessing our website, you agree to respect our intellectual property. JR Academy Pty Ltd reserves all rights, including patents, trademarks, and copyrights. Any infringement will be subject to legal prosecution. View Terms of Service

© 2017-2026 JR Academy Pty Ltd. All rights reserved.

ABN 26621887572

HomeLearnCoursesCerts
首页/匠人TV
AI Eval的基础和在生产环境里的应用
匠人 TV

AI Eval的基础和在生产环境里的应用

发布2026/09/22
关注我们
YouTubeBilibili

视频简介

本次活动由 前德勤 Senior AI Engineer Jessie 老师主讲，从一段真实的 Agent 执行记录出发，围绕评估设计、失败诊断、AI 评委校准和工程落地，系统讲解如何建立一套可度量、可诊断、能持续迭代的 AI 应用评估机制

常见问题

这个视频主要讲什么内容？
本次活动由 前德勤 Senior AI Engineer Jessie 老师主讲，从一段真实的 Agent 执行记录出发，围绕评估设计、失败诊断、AI 评委校准和工程落地，系统讲解如何建立一套可度量、可诊断、能持续迭代的 AI 应用评估机制
在哪里可以观看这个视频？
可以在匠人学院官网观看；本页还提供 YouTube 和 Bilibili 播放入口。
近期开课hot

Build Your Business Idea with Claude — Melbourne — 8 November 2026

start2026/11/07 23:00 (Sydney)

AI Marketing实战

start2026/11/14 00:00 (Sydney)

Claude Agent Workshop — Melbourne — 15 November 2026

start2026/11/14 23:00 (Sydney)

更多课程