-1.png "ATP 2023 web banner (1920 × 500 px)-1")
ATP 2023: Innovations in Testing Conference
March 12-15 | Dallas, TX
Join us in a conference session, visit our booth (#225), or stop by our hospitality suite for more information about Certiverse and our conference presentations.
AI and ML in Assessment: Opportunities and Considerations
Read the full session description >
Monday, March 13 | 9:55 - 10:45 am
Presenters:
Alan Mead, Certiverse
Nathan Thompson, Assessment Systems Corporation
DEI Begins in Development: Strategies and Technologies to Increase SME Diversity, Equity, and Inclusion
Read the full session description >
Monday, March 13 | 4:25-5:15 pm
Presenters:
Byinna Crowder, Certiverse
Gary Fluitt, Stripe
From Background Player to Leading Role: Give Your Job Analysis the Star Treatment
Read the full session description >
Tuesday, March 14 | 11:35-12:25 pm
Presenters:
Gary Fluitt, Stripe
Alan Mead, Certiverse,
Kara Pritchard, The Linux Foundation
Come by for a demo or discussion
We'll be available at a variety of times during the conference to provide more information about Certiverse. Let us know to save space for you at one of our demo breaks in suite 953 or request an individual meeting below.
Meet with our team
Schedule time with Abby Attieh
Schedule time with Byinna Crowder
Schedule time with Ruben Garcia
Monday, March 13 | 9:55 - 10:45 am
AI and ML in Assessment: Opportunities and Considerations
Presenters: Alan Mead, Certiverse / Nathan Thompson, Assessment Systems Corporation
Artificial intelligence (AI) and machine learning (ML) have become buzzwords in everyday life over the past decade. However, these topics have been around in the assessment field far longer than that – more than a century in some manifestations. How has our field been driven by AI and ML, and where will it be heading in the future? This presentation will discuss some examples of this: automated essay scoring, computerized adaptive testing, psychometric forensics, automated item generation, process data scoring, detection of enemy items or essay plagiarism with NLP, and computational psychometrics. The field has advanced more and more quickly over the past decade as new technology has democratized AI and ML. For example, automated essay scoring used to be only available to multimillion dollar (or larger) organizations, but can now be done with minimal code using free tools like R and Python. This has impacted nearly the entire test development cycle, from writing the first item to the reporting of student scores. Yet while they have been around, they remain underutilized, and we face many opportunities to leverage AI and ML in solving future challenges and creating entirely new prospects. What will newer technologies, like virtual reality, mean for the world of assessment? How can we more effectively tie assessment into the endeavors it supports, from learning to employee selection? We will conclude with a discussion of such future opportunities.
Monday, March 13 | 4:25-5:15 pm
DEI Begins in Development: Strategies and Technologies to Increase SME Diversity, Equity, and Inclusion
Presenters: Byinna Crowder, Certiverse / Gary Fluitt, Stripe
Testing and certification organizations are increasingly aware of the importance of diversity and representation in their testing programs. Diversity, equity, and inclusion have become a priority for testing programs as the need to promote wider representation has become essential in a global testing society. While many organizations are eager to attract a more diverse pool of candidates, how do organizations ensure that they are also attracting a diverse pool of Subject Matter Experts?
A globally recognized IT organization identified the need for new certifications addressing new technologies that could be brought to market quickly. By adopting an asynchronous model, the test sponsor was able to not only expand its pool of SMEs to include professionals often excluded from the in-person item development process, but also greatly accelerate the exam’s speed-to-market.
In this presentation, we’ll share best practices for asynchronous exam development that foster inclusion, lessons learned about motivating and incentivizing SME contributors, and the organization’s results from building more representative communities of experts.
Tuesday, March 14 | 11:35-12:25 pm
From Background Player to Leading Role: Give Your Job Analysis the Star Treatment
Presenters: Gary Fluitt, Stripe / Alan Mead, Certiverse / Kara Pritchard, The Linux Foundation
At a high level, we expect just about everyone at ATP has some exposure to the Job Analysis process. We know that Job (or Role) Analysis is the method we use to determine the knowledge, skills, abilities, and other characteristics (KSAOs) needed for success in a role.
What we want to talk about, however, is how to accelerate that work. The panelists in our presentation have experience completing these analyses in new ways, bringing SMEs together from around the globe and working with them more closely as test sponsors to have better results.
Job analysis methods vary to specific exam development needs and teams involved. Our panelists will share how they extended their analysis practices to include more tools, more team members, and more SMEs to work together for better results.
By the end of our presentation, we’ll cover multiple breakthrough approaches that dramatically increase the speed at which the job analysis can be completed. We’ll have discussed the pitfalls and caveats of these processes and will make attendees more informed producers and consumers of Job Analysis the next time they encounter this process.