Abstract

A system and process for dynamic security monitoring of test taking. The system combines historical information about the test taker or relevant conditions, and includes sensors which objectively monitor test taker's actions, inactions, and involuntary response to the test given before and during the test, and at a specific test location. The information collected from the sensors is compared to a plurality of predetermined individual risk factors, which indicate a possibility of test fraud by the individual test taker to create a test event risk profile. The individual risk profile is combined with non-individual specific risk factors to create a holistic test event security profile. Security resources are then dynamically assigned to or removed from the test event based on the unique test event security profile.

IPC Classes  ?

• G09B 7/00 - Electrically-operated teaching apparatus or devices working with questions and answers
• G06Q 10/0631 - Resource planning, allocation, distributing or scheduling for enterprises or organisations
• G06Q 50/20 - Education
• G06V 20/52 - Surveillance or monitoring of activities, e.g. for recognising suspicious objects
• G06V 40/20 - Movements or behaviour, e.g. gesture recognition

Goods & Services

Cloud-based technology solution, namely, software as a service (SAAS) services featuring cloud-based software technology for assessment testing for employment, educational, certification, licensure and credentialing, for analyzing test taker responses and interactive test administration data to ensure validity and integrity of test administration and to limit security threats and cheating for assessment testing in the fields of employment, educational, certification, licensure and credentialing; Cloud-based technology solution, namely, software as a service (SAAS) services featuring cloud-based software technology for monitoring and reporting test taker response and interactive test administration data in remote and online administration of educational, employment, certification, licensure and credentialing tests to ensure validity and integrity of test administration and to limit security threats and cheating; Cloud-based technology solution, namely, software as a service (SAAS) services featuring cloud-based software technology for monitoring and analyzing test taker response and interactive test administration data in remote and online administration of educational, employment, certification, licensure and credentialing test administration using sensor and data collection devices and reporting data relevant to security threats and cheating; Providing temporary use of on-line non-downloadable cloud computing software for monitoring, analyzing, and controlling communications between computers on which tests are administered and test administration computer systems to identify and limit security threats and cheating on remote and/or online educational, employment, certification, licensure and credentialing tests

Abstract

Systems and processes are provided for analyzing a test taker's knowledge, skills, and cognitive function. The systems and processes include smart questions (i.e., SmartItems) programmed with coded variables, or for multiple choice varieties, variable sets of options to cover an entire skill set being tested. The systems and processes generate questions in real time during administration of the test, by formulating and displaying, to a test taker, random combinations of a question stem and randomly-selected question components. This smart question content is unpredictably and randomly presented, as representations of the skill to be tested. The systems and processes analyze the test taker's knowledge, skills, and cognitive function about the entire domain of the skill, rather than a single fact. The systems and processes provide security to test administration.

IPC Classes  ?

• G09B 7/00 - Electrically-operated teaching apparatus or devices working with questions and answers
• G09B 7/02 - Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by the student
• G09B 7/077 - Electrically-operated teaching apparatus or devices working with questions and answers of the multiple-choice answer type, i.e. where a given question is provided with a series of answers and a choice has to be made from the answers providing for individual presentation of questions to a plurality of student stations different stations being capable of presenting different questions simultaneously

Abstract

A system and process for dynamic security monitoring of test taking. The system combines historical information about the test taker or relevant conditions, and includes sensors which objectively monitor test taker's actions, inactions, and involuntary response to the test given before and during the test, and at a specific test location. The information collected from the sensors is compared to a plurality of predetermined individual risk factors, which indicate a possibility of test fraud by the individual test taker to create a test event risk profile. The individual risk profile is combined with non-individual specific risk factors to create a holistic test event security profile. Security resources are then dynamically assigned to or removed from the test event based on the unique test event security profile.

IPC Classes  ?

• G09B 7/00 - Electrically-operated teaching apparatus or devices working with questions and answers
• G06Q 10/0631 - Resource planning, allocation, distributing or scheduling for enterprises or organisations
• G06Q 50/20 - Education
• G06V 20/52 - Surveillance or monitoring of activities, e.g. for recognising suspicious objects
• G06V 40/20 - Movements or behaviour, e.g. gesture recognition

Abstract

Systems and processes are provided for analyzing a test taker's knowledge, skills, and cognitive function. The systems and processes include smart questions (i.e., SmartItems) programmed with coded variables, or for multiple choice varieties, variable sets of options to cover an entire skill set being tested. The systems and processes generate questions in real time during administration of the test, by formulating and displaying, to a test taker, random combinations of a question stem and randomly-selected question components. This smart question content is unpredictably and randomly presented, as representations of the skill to be tested. The systems and processes analyze the test taker's knowledge, skills, and cognitive function about the entire domain of the skill, rather than a single fact. The systems and processes provide security to test administration.

IPC Classes  ?

• G09B 7/00 - Electrically-operated teaching apparatus or devices working with questions and answers
• G09B 7/02 - Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by the student
• G09B 7/077 - Electrically-operated teaching apparatus or devices working with questions and answers of the multiple-choice answer type, i.e. where a given question is provided with a series of answers and a choice has to be made from the answers providing for individual presentation of questions to a plurality of student stations different stations being capable of presenting different questions simultaneously

Abstract

A system and process for dynamic security monitoring of test taking. The system combines historical information about the test taker or relevant conditions, and includes sensors which objectively monitor test taker's actions, inactions, and involuntary response to the test given before and during the test, and at a specific test location. The information collected from the sensors is compared to a plurality of predetermined individual risk factors, which indicate a possibility of test fraud by the individual test taker to create a test event risk profile. The individual risk profile is combined with non-individual specific risk factors to create a holistic test event security profile. Security resources are then dynamically assigned to or removed from the test event based on the unique test event security profile.

IPC Classes  ?

• G09B 7/00 - Electrically-operated teaching apparatus or devices working with questions and answers
• G06Q 50/20 - Education
• G06Q 10/0631 - Resource planning, allocation, distributing or scheduling for enterprises or organisations

Abstract

Systems and processes are provided for analyzing a test taker's knowledge, skills, and cognitive function. The systems and processes include smart questions (i.e., SmartItems) programmed with coded variables, or for multiple choice varieties, variable sets of options to cover an entire skill set being tested. The systems and processes generate questions in real time during administration of the test, by formulating and displaying, to a test taker, random combinations of a question stem and randomly-selected question components. This smart question content is unpredictably and randomly presented, as representations of the skill to be tested. The systems and processes analyze the test taker's knowledge, skills, and cognitive function about the entire domain of the skill, rather than a single fact. The systems and processes provide security to test administration.

IPC Classes  ?

• G09B 7/00 - Electrically-operated teaching apparatus or devices working with questions and answers
• G09B 7/02 - Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by the student
• G09B 7/077 - Electrically-operated teaching apparatus or devices working with questions and answers of the multiple-choice answer type, i.e. where a given question is provided with a series of answers and a choice has to be made from the answers providing for individual presentation of questions to a plurality of student stations different stations being capable of presenting different questions simultaneously

Goods & Services

Providing educational assessment and testing services, namely, monitoring of secure test administrations; Analyzing of educational test scores and data regarding the results of searching for infringing test content and plagiarism, for others Software as a service (SAAS) services featuring software to monitor social media platforms, chatrooms, bulletin boards and commercial and non-commercial websites to identify infringing test content copied and/or distributed without permission of the test publisher or test sponsor and/or information related to potential examinee violations of assessment or testing rules, before, during and after secure test administrations, and removing infringing test content from the Internet to ensure the validity of assessments and tests used for education, certification, licensure, admissions, employment and credentialing decisions; providing a website featuring technology enabling users to remotely obtain the results of Internet searches to identify infringing test content copied and/or distributed without permission of the test publisher or test sponsor and/or information related to potential examinee violations of assessment or testing rules, and the results of efforts to remove infringing test content from the Internet to ensure the validity of assessments and tests used for education, certification, licensure, admissions, employment and credentialing decisions

Goods & Services

Providing educational assessment and testing services namely, statistical analysis of test response data for the purpose of ensuring the validity of assessments and tests used for employment, certification, licensure and credentialing decisions Providing educational assessment and testing services namely, designing secure forms of test administration methods for use in administering exams, development of secure questions and answer options to be included in secure tests, monitoring of secure test administrations, and training for people who manage secure testing programs and administer secure tests, all for the purpose of ensuring the validity of assessments and tests used for education, certification, licensure, admissions, employment and credentialing decisions; Providing educational assessment and testing services namely, statistical analysis of test response data for the purpose of ensuring the validity of assessments and tests used for education and admissions decisions Providing scientific analysis services in the fields of measurement of intelligence or knowledge, statistics, and psychometrics that support and enhance the development, delivery, analysis, processing and validity of secure tests and assessments and test and assessment response data used for education, certification, licensure, admissions, employment and credentialing decisions; Providing non- downloadable, cloud-based technology, and software used for the creation of secure test items in the nature of digital adaptive test questions and exam questions and test forms, the secure delivery of test forms and items to test takers, and processing and analyzing data generated during tests and assessments used for education, certification, licensure, admissions, employment and credentialing decisions; Providing educational assessment and testing services namely, secure educational and assessment testing computer program design, secure educational and assessment testing computer program development, and design of secure forms of computer software for test administration; Providing educational assessment and testing services namely, monitoring of the Internet for secure test item exposure and other threats to the validity of tests and testing programs for the purpose of ensuring the validity of assessments and tests used for education, certification, licensure, admissions, employment and credentialing decisions; Providing educational assessment and testing services namely, conducting investigations of potential testing irregularities in the nature of computer security threat monitoring and analysis for protecting electronic testing data, all for the purpose of ensuring the validity of assessments and tests used for education, certification, licensure, admissions, employment and credentialing decisions; providing professional computer system, computer software, and computer network auditing and investigative consulting services to organizations that use tests or assessments to make important decisions, for the purpose of evaluating, auditing, preventing, detecting, monitoring, responding to and understanding test security threats and risks in the nature of theft and/or unauthorized exposure of confidential test or assessment content that would undermine the value of the test or assessment and its results; Providing educational assessment and testing services namely, statistical analysis of test response data for the purpose of ensuring the validity of assessments and tests used for certification and licensure decisions Providing professional intellectual property protection consulting services in the field of maintaining the security, validity and integrity of tests and assessments used for education, certification, licensure, admissions, employment and credentialing decisions, in the nature of the confidential intellectual property that comprises the secure test and assessment content contained in tests and assessments to protect it from theft and/or unauthorized exposure that would undermine its value as an assessment, as well as the value of assessment results; Providing educational assessment and testing services namely, conducting investigations of potential testing irregularities in the nature of investigating potential non-digital and non-electronic examination and assessment testing fraud and unauthorized exposure or theft of secure test content, all for the purpose of ensuring the validity of assessments and tests used for education, certification, licensure, admissions, employment and credentialing decisions

Goods & Services

Providing assessment and testing services, namely, designing, developing, and administering dynamic assessment and test questions and response options containing computer programming code for use in standardized computer-based tests and assessments used to determine whether individuals meet standards for employment and credentialing decisions and evaluations Providing educational assessment and testing services, namely, designing, developing, and administering dynamic assessment and test questions and response options containing computer programing code for use in standardized computer-based tests and assessments used for education and academic admissions purposes Providing a cloud-based, non-downloadable computer software platform for designing, developing and administering dynamic assessment and test questions and response options containing computer programing code for use in standardized computer-based tests and assessments used to determine whether individuals meet standards for professional certification and licensure and for education, admissions, employment and credentialing decisions; Providing assessment and testing services, namely, designing, developing, and administering dynamic assessment and test questions and response options containing computer programing code for use in standardized computer-based tests and assessments used to determine whether individuals meet standards for professional certification and licensure

Goods & Services

Consulting services in the field of maintaining the security and integrity of educational tests; Consulting services in the field of maintaining security of educational tests, namely, making informed test security recommendations to organizations; providing information on test security topics; Consulting services in the field of maintaining security of educational tests, namely, creating resources, documents, and policies for an organization or testing program on test security topics; consulting on test security threats, risks, solutions; security consulting services, namely, providing test security recommendations to an educational testing program; providing professional advice and consulting services to an educational testing organization and testing programs at meetings and conferences where test security topics are presented or discussed