Full Program 2019
 
Sunday, March 17, 2019
3:00 pm - 4:00 pmSponsor Briefing
5:00 pm - 6:00 pmFirst-time Attendee Reception and Remarks [More Info]
6:00 pm - 7:00 pmInnovations in Testing Opening Cocktail Reception [More Info]
 
Monday, March 18, 2019
7:30 am - 8:30 amBreakfast with Exhibitors
8:30 am - 10:00 amOpening General Session and Keynote Address [More Info]
10:00 am - 10:15 amNetworking Break with Exhibitors
10:15 am - 11:15 amApplying Diagnostic Classification Models to Educational, Licensure, and Certification Assessment: Test Development, Validity, and Reliability [More Info]
10:15 am - 11:15 amBadges AND Certifications: Opportunities in all Credential Formats [More Info]
10:15 am - 11:15 amBias, Transparency, Ethics and AI. How to Realize the Potential While Complying with the [Un]expected [More Info]
10:15 am - 11:15 amBuild the Right Software First Time Around and on Budget [More Info]
10:15 am - 11:15 amDeveloping a World Class Dual-Language CAT Program [More Info]
10:15 am - 11:15 amFEATURED SPEAKER SESSION: High-Tech High-Touch Workplace Improvement [More Info]
10:15 am - 11:15 amFEATURED SPEAKER SESSION: Innovation Behind Bars [More Info]
10:15 am - 11:15 amFEATURED SPEAKER SESSION: Workforce Skills Credential and Certification in Asia: Challenges and Opportunities [More Info]
10:15 am - 11:15 amLarge Scale National Diagnostic Assessment in Italy: A Case Study [More Info]
10:15 am - 11:15 amPerform vs. Practice - A Case Study in Two Different Item Development Strategies [More Info]
10:15 am - 11:15 amSecurity: Will it Matter in 2023? [More Info]
10:15 am - 11:15 amSPONSOR SESSION (Professional Testing): MIND THE GAPS! - The Paradox of the “Skills Gap” in a Low Unemployment Economy [More Info]
10:15 am - 11:15 amTransform Your Test Security by Upgrading Your Items [More Info]
11:15 am - 11:30 amNetworking Break with Exhibitors
11:30 am - 12:30 pmA Case Study Comparing Item Writing Training Methodologies: One Organization's Journey from In-Person to Remote Subject Matter Expert Training [More Info]
11:30 am - 12:30 pmA New Way to Test: Creating and Using Animated Scenarios for a Licensure Exam [More Info]
11:30 am - 12:30 pmEnhancing the Candidate Test-Taking Experience: What Are We Doing? [More Info]
11:30 am - 12:30 pmFEATURED SPEAKER SESSION: Envisioning Future Exam Security in Response to Evolving Technologies [More Info]
11:30 am - 12:30 pmFEATURED SPEAKER SESSION: Workforce Skills from an Employer’s Perspective [More Info]
11:30 am - 12:30 pmImproving the Authenticity of Medical Licensure and Certification Exams With Innovative Tools and Item Types [More Info]
11:30 am - 12:30 pmIndustry Standards for the Implementation of Automated Scoring Technologies [More Info]
11:30 am - 12:30 pmMedical Devices in the Test Room [More Info]
11:30 am - 12:30 pmThe Promise and Practice of Next Generation Assessment [More Info]
11:30 am - 12:30 pmThe Use of Artificial Intelligence and Testing in Early Detection of At-Risk Learners [More Info]
11:30 am - 12:30 pmWho, What, When, Where, and Why: The Five W’s of Score Reporting [More Info]
12:30 pm - 2:00 pmLunch with Exhibitors and Product Demonstrations [More Info]
12:30 pm - 2:00 pmPRODUCT DEMONSTRATION: ACE (Adolescent Comprehension Evolution) [More Info]
12:30 pm - 2:00 pmPRODUCT DEMONSTRATION: Ada: AI Driven Assessment [More Info]
12:30 pm - 2:00 pmPRODUCT DEMONSTRATION: Breaking Down Blockchain: Is It Right for Your Credential? [More Info]
12:30 pm - 2:00 pmPRODUCT DEMONSTRATION: CASPer: An Online SJT that Assesses People Skills [More Info]
12:30 pm - 2:00 pmPRODUCT DEMONSTRATION: Conserve Resources by Testing Ability & Knowledge in One Mini-Certification [More Info]
12:30 pm - 2:00 pmPRODUCT DEMONSTRATION: Current State of Mobile Internet Testing [More Info]
12:30 pm - 2:00 pmPRODUCT DEMONSTRATION: Demonstrating the Power of Open Source and Open Standards [More Info]
12:30 pm - 2:00 pmPRODUCT DEMONSTRATION: Digital Asset Remote Item Development Projects - The Evolution of Exhibit Acquisition [More Info]
12:30 pm - 2:00 pmPRODUCT DEMONSTRATION: Dynamic Reporting of Personality Assessment [More Info]
12:30 pm - 2:00 pmPRODUCT DEMONSTRATION: Everybody Grows! A Positive Assessment Platform for Math [More Info]
12:30 pm - 2:00 pmPRODUCT DEMONSTRATION: Evolution of Continuous Learning and Assessment for Healthcare Professionals [More Info]
12:30 pm - 2:00 pmPRODUCT DEMONSTRATION: Integrating Formative Assessments into Online Class-Based Testing [More Info]
12:30 pm - 2:00 pmPRODUCT DEMONSTRATION: Iteman/Xcalibre: Psychometrics as a Service [More Info]
12:30 pm - 2:00 pmPRODUCT DEMONSTRATION: StoryTell: Assessing Young Childrens’ Speaking Ability through Phones [More Info]
12:30 pm - 2:00 pmPRODUCT DEMONSTRATION: The Learn Feedback Program Version 2 [More Info]
12:30 pm - 2:00 pmPRODUCT DEMONSTRATION: Using AI Robots to Test the Testing Software [More Info]
2:00 pm - 3:00 pmA Contemporary Take on the Education Triangle: Teaching, Learning and Testing in Digital Environments [More Info]
2:00 pm - 3:00 pmAccommodations Research: What the Data Tell Us [More Info]
2:00 pm - 3:00 pmComparability or Equivalency: The Parallels Between Remote Proctoring and Test Centre Exam Delivery through Data and Lessons Learned. [More Info]
2:00 pm - 3:00 pmFEATURED SPEAKER SESSION: A Survey of Recertification and Renewal Practices in Credentialing [More Info]
2:00 pm - 3:00 pmFEATURED SPEAKER SESSION: Current Trends in Digital Learning Systems [More Info]
2:00 pm - 3:00 pmFinding a Suitable Task Analysis for Developing Competency-Based Statements [More Info]
2:00 pm - 3:00 pmFully Automated Assessment [More Info]
2:00 pm - 3:00 pmGathering Standard Setting Validity Evidence for a High-Stakes Assessment: Planning and Practical Experiences [More Info]
2:00 pm - 3:00 pmHow Many Retakes Should a Licensure Examination Candidate be Allowed? [More Info]
2:00 pm - 3:00 pmLeveraging Your Testing Ecosystem [More Info]
2:00 pm - 3:00 pmThe Benefits and Challenges of Moving Traditional Assessments into the Digital World [More Info]
3:00 pm - 4:00 pmDessert with Exhibitors
4:00 pm - 5:00 pmAccessibility – The Challenge of Inclusion [More Info]
4:00 pm - 5:00 pmAssessing Professional Judgement in the Information Age [More Info]
4:00 pm - 5:00 pmAvoiding Test Day Latency: Preventing Internet Interruption for Performance-Based Assessment [More Info]
4:00 pm - 5:00 pmChoosing Wisely: So Many Options for Assessment Administration. Which Will Enhance Your Exam’s Validity and Fairness? [More Info]
4:00 pm - 5:00 pmDemystifying SME Engagement: Practical Tools and Tips [More Info]
4:00 pm - 5:00 pmFEATURED SPEAKER SESSION: The Future of Apprenticeships and Assessments [More Info]
4:00 pm - 5:00 pmFEATURED SPEAKER SESSION: What You Need to Know about Data Privacy Laws: International, Federal, State and Local [More Info]
4:00 pm - 5:00 pmLessons Learned from Delivering a Performance Based Test in China [More Info]
4:00 pm - 5:00 pmMultistage Testing: Theory and Practice [More Info]
4:00 pm - 5:00 pmPerformance-Based Testing: Microsoft’s Journey from Desktop to Cloud [More Info]
4:00 pm - 5:00 pmPioneering a New Approach to Test Design and Development [More Info]
4:00 pm - 5:00 pmUpsetting the Item Writing Apple Cart Via Rapid Item Generation: Lessons Learned from Developing AIG and AE Models for High-Stakes Certification and Licensure Exams [More Info]
5:30 pm - 7:00 pmePOSTER SESSION: A Primer on Diagnostic Measurement: Obtaining Actionable Score Profiles [More Info]
5:30 pm - 7:00 pmePOSTER SESSION: A Story about Qlik and NBME [More Info]
5:30 pm - 7:00 pmePOSTER SESSION: All Hands on Deck! A Crisis Management Plan for Test Administration Disruptions [More Info]
5:30 pm - 7:00 pmePOSTER SESSION: Automated Test Form Assembly: The Evolution of Test Development [More Info]
5:30 pm - 7:00 pmePOSTER SESSION: Clustering Clickstream Behaviors to Identify Aberrant Performance in High-Stakes Testing [More Info]
5:30 pm - 7:00 pmePOSTER SESSION: Does It Matter Which Psychometric Software You Use? Yes [More Info]
5:30 pm - 7:00 pmePOSTER SESSION: East Meets West: Validity-Centric Development of a Cultural Agility and Competency Prediction Solution [More Info]
5:30 pm - 7:00 pmePOSTER SESSION: How Many Items Do I Need to Assess Mastery? [More Info]
5:30 pm - 7:00 pmePOSTER SESSION: Human SME Judgement Accuracy in Predicting Item Statistical Characteristics: Implications For SME Selection, Training, and Item Bank Growth Forecasting [More Info]
5:30 pm - 7:00 pmePOSTER SESSION: Impact on Calibrating Items Using Various Sample Groups [More Info]
5:30 pm - 7:00 pmePOSTER SESSION: Implementing a Simple Text-Mining Analysis to Interpret Examinee Free Text Survey Responses [More Info]
5:30 pm - 7:00 pmePOSTER SESSION: Item Review Face-off: Remote vs. In-person [More Info]
5:30 pm - 7:00 pmePOSTER SESSION: New Ways to Benefit from Automated Item Generation (AIG) [More Info]
5:30 pm - 7:00 pmePOSTER SESSION: Open Innovation in Digital Assessments [More Info]
5:30 pm - 7:00 pmePOSTER SESSION: Thinking About the Future – Predictive Analytics in Summative Testing [More Info]
5:30 pm - 7:00 pmePOSTER SESSION: Using Eye Tracking Data to Investigate the Impact of Testing Interface on Response Processes [More Info]
5:30 pm - 7:00 pmePOSTER SESSION: Using Machine Learning to Score Performance Based Tests: Lessons Learned [More Info]
5:30 pm - 7:00 pmePOSTER SESSION: Using NLP to Select Items from AIG Output [More Info]
5:30 pm - 7:00 pmReception with Exhibitors and ePoster Sessions
 
Tuesday, March 19, 2019
7:30 am - 8:30 amBreakfast with Exhibitors
8:30 am - 10:00 amFEATURED SPEAKER SESSION: Gamified Assessment in Employee Selection: Development, Validation, and Technology Advances [More Info]
8:30 am - 10:00 amFEATURED SPEAKER SESSION: Meeting the Data Privacy Challenge: Complying with Multiple Laws in a Global Testing Environment [More Info]
8:30 am - 10:00 amFinding a Fit: Building a Positive Vendor / Client Relationship [More Info]
8:30 am - 10:00 amHow Do I Code Thee? Let Me Count the Ways [More Info]
8:30 am - 10:00 amINNOVATION DEBATE: Testing as a Profession: Should We Be Certified and/or Self-Regulated? [More Info]
8:30 am - 10:00 amINNOVATION DEBATE: The Debate Goes On: Differing Perspectives on Recertification and Maintenance of Certification [More Info]
8:30 am - 10:00 amInnovations Hackathon Part I [More Info]
8:30 am - 10:00 amLearner Readiness: The Most Important Step in Developing Assessments [More Info]
8:30 am - 10:00 amModels are for More Than Just Psychometrics: Innovations in Content Development That Every Testing Organization Should Still Be Considering Seriously [More Info]
10:00 am - 10:30 amNetworking Break with Exhibitors
10:30 am - 12:00 pmFEATURED SPEAKER SESSION: Measuring Competency or Redefining the “Test”: Games and Simulations as Disruptive Assessment Tools [More Info]
10:30 am - 12:00 pmGuerrilla Tactics for Prototyping and User Testing [More Info]
10:30 am - 12:00 pmHow Do We Develop Effective Scenarios for Assessment? [More Info]
10:30 am - 12:00 pmINNOVATION DEBATE: Are We Testing our Kids Too Frequently? [More Info]
10:30 am - 12:00 pmINNOVATION DEBATE: Should We Use Technology and Statistics to End or Alter Testing Sessions When We Suspect Cheating or Item Theft? [More Info]
10:30 am - 12:00 pmInnovations Hackathon Part II [More Info]
10:30 am - 12:00 pmShifting to a Design Science Paradigm to Develop Desirable, Feasible, and Viable Tests [More Info]
12:00 pm - 1:15 pmLunch with Exhibitors
1:15 pm - 2:15 pmAnalyze That! Managing Multiple Job Analyses for a Complex Organization [More Info]
1:15 pm - 2:15 pmBack to the Future: Insights from Delphi on the Testing Industry [More Info]
1:15 pm - 2:15 pmDisentangling Scores, Times, and Security Considerations [More Info]
1:15 pm - 2:15 pmFEATURED SPEAKER SESSION: How is Globalization Shaping Assessment? [More Info]
1:15 pm - 2:15 pmFEATURED SPEAKER SESSION: Teacher Leadership and Educator Ethics: Why Assessing These Domains Matters [More Info]
1:15 pm - 2:15 pmFundamentals of Secure Testing - Security Goals Policies, Training, and Quality Control [More Info]
1:15 pm - 2:15 pmIncreasing Test Program Efficiency Using Computerized Adaptive Testing (CAT) [More Info]
1:15 pm - 2:15 pmIs Your Program Ready For Remote Proctoring? [More Info]
1:15 pm - 2:15 pmItem Authoring at Scale - Combining Technology, Communication, and Agile Thinking to Implement Secure High-Stakes Remote Authoring. [More Info]
1:15 pm - 2:15 pmSEL: Assessing Learners’ Soft Skills Through Structured Video Workflows [More Info]
1:15 pm - 2:15 pmTechnology-Based Assessment Guidelines: Present and Future [More Info]
1:15 pm - 2:15 pmTranslation Is Not Enough: Preparing Your Exam for a Global Environment [More Info]
2:15 pm - 4:15 pmDessert with Exhibitors
2:45 pm - 4:00 pmInnovations in Testing 2019 Innovation Lab [More Info]
4:15 pm - 5:15 pmCreating a Path to Certification on Trailhead [More Info]
4:15 pm - 5:15 pmDeveloping Situational Judgment Tests: Not as Frightening as You Think! [More Info]
4:15 pm - 5:15 pmFEATURED SPEAKER SESSION: Modern Approaches to Assessment for Employment Selection [More Info]
4:15 pm - 5:15 pmFEATURED SPEAKER SESSION: Past, Present, and Future With Artificial Intelligence [More Info]
4:15 pm - 5:15 pmOne Year Later: Best Practices from Implementing Secure Continuous Assessments in Medical Licensure Environments [More Info]
4:15 pm - 5:15 pmRepresenting Cognitive Complexity in Test Design and Evaluation [More Info]
4:15 pm - 5:15 pmUsing Natural Language Processing to Automated Item Enemy Identification to Improve Item Banking and Test Security [More Info]
4:15 pm - 5:15 pmUsing Nudges for More Effective Exam Programs [More Info]
4:15 pm - 5:15 pmWho Are You Calling an Outlier? Managing Standard-Setting Data [More Info]
5:15 pm - 6:15 pmSponsor Debrief [More Info]
 
Wednesday, March 20, 2019
7:30 am - 8:30 amContinental Breakfast
8:30 am - 9:30 amAudience Engagement Beyond Certification [More Info]
8:30 am - 9:30 amCAT in a Box: Implementing a Standard on Computer Adaptive Testing [More Info]
8:30 am - 9:30 amCheating Networks: A Case Study in Cheating Detection [More Info]
8:30 am - 9:30 amDoes Virtual Reality Have a Role to Play in High-Stakes Certification? [More Info]
8:30 am - 9:30 amImproving Access and Equity as a Goal of Testing [More Info]
8:30 am - 9:30 amIt's Not You, It's Me: Knowing When To Move To A New Test [More Info]
8:30 am - 9:30 amSo You're Thinking About Implementing Automated Item Generation at Your Organization? Practical Issues You’ll Wish You Considered Beforehand [More Info]
8:30 am - 9:30 amStories from the Front Lines: A Panel Discussion on Implementing Item Protection Strategies in IT Certification Programs [More Info]
8:30 am - 9:30 amStrategic Practice Analysis: Beyond the Basics [More Info]
8:30 am - 9:30 amThe Ins and Outs of Introducing Alternative Item Types [More Info]
8:30 am - 9:30 amWhat Makes a Difference for Candidates Taking Computer-Based Tests? The Impact of Devices and User Interface Tools [More Info]
8:30 am - 9:30 amWhen Good Data Goes Bad: Misuse of Assessment Data and How to Combat It [More Info]
9:30 am - 9:45 amBreak
9:45 am - 10:45 amAssessment Innovation and the Validity-Diversity Dilemma: Challenges and Opportunities [More Info]
9:45 am - 10:45 amCommunicating Technical Testing Concepts to Non-Technical Audiences: Key Elements to Consider [More Info]
9:45 am - 10:45 amDisruptions In Assessment [More Info]
9:45 am - 10:45 amLegislative Impacts on Certification [More Info]
9:45 am - 10:45 amOnline Proctoring & High Stakes Certifications: Best Practices for Securing Your Exams [More Info]
9:45 am - 10:45 amSensors, Devices, and Assessments, Oh My! [More Info]
9:45 am - 10:45 amStandard Setting from the Perspective of Facilitator, Participant, and Decision Maker [More Info]
9:45 am - 10:45 amTest Development As A Profession: Attracting and Retaining Top Editorial Talent, and Their Role in Programmatic Success [More Info]
9:45 am - 10:45 amTest Security Breaches: Establishing Policies and Enforcing Decisions [More Info]
9:45 am - 10:45 amThe Role of Psychometrics in Assessment-Based Certificate Programs: Crank it Up or Dial it Back? [More Info]
9:45 am - 10:45 amTo PBT or NOT to PBT: That Depends on the Content [More Info]
9:45 am - 10:45 amWhy Do We Need to Talk about Threatening Test Taker Behavior? [More Info]
11:00 am - 12:15 pmClosing General Session
2:00 pm - 4:00 pmPost Conference Workshop - Presenting Data Effectively [More Info]