Goods & Services

Downloadable computer software for use in live digital communications, namely, live video and audio conferencing and network conferencing in the field of English language proficiency testing and test preparation; downloadable computer software for the transmission, recording, reproduction, display, organization, management, manipulation and review of messages, text, images, files, audio, video, audio-visual and multimedia content in the field of English language proficiency testing and test preparation; digital video cameras for use in the field of English language proficiency testing and test preparation; microphones for use in the field of English language proficiency testing and test preparation; recorded computer software for screening potential test takers in the field of English language proficiency testing and test preparation; downloadable computer software for screening potential test takers in the field of English language proficiency testing and test preparation; electronic downloadable publications, namely, books, informational brochures, pamphlets, circulars, instruction sheets, manuals, research reports and newsletters, all in the field of English language proficiency testing Printed publications, namely, books, informational brochures, pamphlets, circulars, instruction sheets, manuals, printed guides, research reports and newsletters, all in the field of English language proficiency testing; printed test forms and printed answer sheets, all in the field of English language proficiency testing; printed publications, namely, educational books, paper teaching materials, study guides, workbooks and printed computer program manuals, all in the field of English language instruction and learning and English language proficiency test preparation; printed publications, namely, books, informational brochures, pamphlets, circulars, instruction sheets, manuals, printed guides, research reports and newsletters for teacher training coursework in the field of language instruction and learning and English language proficiency Educational testing services, namely, creating, administering, scoring and reporting an internet-based language proficiency test; arranging and conducting professional development workshops in the field of English language learners, language instruction and English language proficiency testing; education services, namely, providing online and in-person education courses and workshops for teachers and educators in the field of English language learners, language instruction and English language proficiency testing; education services, namely, providing test preparation services being preparing, administering, and scoring academic tests for English language proficiency; providing online non-downloadable pre-recorded videos related to tests of English language proficiency; providing information relating to educational testing, namely, tests of English language proficiency and test administrations; providing online non-downloadable test preparation materials in the nature of e-books, study guides, teaching review materials, practice exams, and score reports in the field of English language proficiency testing; educational testing services in the nature of development and administration of an internet-based language proficiency test Providing temporary use of non-downloadable online software for an internet-based language proficiency test; providing temporary use of non-downloadable online software for use by teachers and educators of English language learners that provides teachers and educators with access to instructional materials and classroom activities designed to personalize instruction for English language learners; providing temporary use of on-line non-downloadable applications for placement tests in the field of English language proficiency

Goods & Services

Providing test registration services for educational administration purposes; online retail store services featuring educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness.

Abstract

Data is received that encapsulates a video of a subject performing a task. This video is used to generate a transcript using an automatic speech recognition (ASR) system. A plurality of text segments are generated from the transcript and then tokenized. A textual representation of each segment is extracted by a transformer model using the tokenized text segment (i.e., the tokens corresponding to the text segment). Thereafter, for each segment, a fused representation derived from the textual representations and corresponding visual and audio features from the video is generated. A sparse attention machine learning model then selects an optimal slice of the video based on the fused representations. The optimal slice can then be input into one or more machine learning models trained to characterize performance of the task by the subject.

IPC Classes  ?

• G10L 15/00 - Speech recognition
• G06F 40/284 - Lexical analysis, e.g. tokenisation or collocates
• G10L 15/16 - Speech classification or search using artificial neural networks
• G10L 15/26 - Speech to text systems

Abstract

An ordered interaction task is initiated in a graphical user interface. A main region of the graphical user interface is segmented into a plurality of discrete sub-regions, each sub-region including content of the ordered interaction task. The user is then prompted to begin the ordered interaction task through a non-visual prompt that is provided concurrently with the graphical user interface. In response to a first user-initiated command received in the graphical user interface, a non-visual presentation of at least a portion of the content of at least one sub-region is provided concurrently with the graphical user interface.

IPC Classes  ?

• G06F 3/0482 - Interaction with lists of selectable items, e.g. menus
• G09B 21/00 - Teaching, or communicating with, the blind, deaf or mute

Abstract

Automatic content generation by one or more computing devices can include receiving data comprising an original sentence with a grammar artifact of interest. Thereafter, a plurality of distractor candidates are generated based on the original sentence with the grammar artifact of interest. At least one machine learning-based language model then scores each of the distractor candidates. These scores characterize a likelihood of the corresponding distractor candidate being selected as part of an assessment by a subject. The distractor candidates can be filtered to result in a filtered list of distractor candidates from which the x top scoring distractor candidates can be selected. A grammar practice item is then generated based on the original sentence and the x top scoring distractor candidates. The grammar practice can then be provided. Related apparatus, systems, and articles are also described.

IPC Classes  ?

• G06F 40/40 - Processing or translation of natural language
• G06F 40/205 - Parsing
• G06F 40/253 - Grammatical analysisStyle critique

Abstract

Quality of a narrative is characterized by receiving data that includes a narrative text. This narrative text is then tokenized and events are extracted from the tokenized words. The extraction can use, in parallel, two or more different extraction techniques. The extracted events are then extracted so that a waveform can be generated based on the aggregated extracted events that characterizes a plurality of emotional arcs within the narrative text. Subsequently, a plurality of waveform elements are extracted from the waveform. The narrative quality (or other quality) of the narrative text is then scored based on the extracted plurality of waveform elements and using a machine learning model trained to correlate emotional arc waveforms with narrative quality scores. Related apparatus, systems, techniques and articles are also described.

IPC Classes  ?

• G06F 40/284 - Lexical analysis, e.g. tokenisation or collocates
• G06F 40/30 - Semantic analysis
• G06N 20/00 - Machine learning

Abstract

Data is received by an automated spoken language learning and assessment system that includes a passage of text comprising a response to stimulus material. Thereafter, at least one machine learning model is used to detect absent key points within the passage of text and/or location spans of key points in the passage of text. The at least one machine learning model can be trained using a corpus with annotated key points and a span for each key point. In addition, each of the detected key points is scored by at least one key point quality model to result in a corresponding key point score. Diagnostic feedback targeting content development skills is then determined based on the detecting and using the key point scores. Data can then be provided which characterizes such diagnostic feedback. Related apparatus, systems, techniques and articles are also described.

IPC Classes  ?

• G10L 15/22 - Procedures used during a speech recognition process, e.g. man-machine dialog
• G06F 40/205 - Parsing
• G06N 7/01 - Probabilistic graphical models, e.g. probabilistic networks
• G10L 25/27 - Speech or voice analysis techniques not restricted to a single one of groups characterised by the analysis technique

Abstract

Data is received that includes a passage of text generated in response to a prompt which comprises a plurality of sentences. Thereafter, the passage of text is tokenized into a plurality of tokens each corresponding to a different word in the passage of text. A first classification head of an adaptive fine-tuned transforms classifies each of the tokens into one of a plurality of classes. A second classification head of the adaptive fine-tuned transformer model classifies each of the sentences as either including or not including an argument. Data can then be provided which characterizes the first and second classifications. Related apparatus, systems, techniques and articles are also described.

IPC Classes  ?

• G06F 40/40 - Processing or translation of natural language
• G06F 40/284 - Lexical analysis, e.g. tokenisation or collocates
• G09B 5/14 - Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication

Goods & Services

Providing test registration services for educational administration purposes; online retail store services featuring educational materials and job and career readiness materials; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness. Audio and video recordings featuring educational language instruction, recorded computer programs, and downloadable computer programs from a global computer network for educational instruction in the field of languages all used for preparing for and practicing standardized tests language proficiency and for use in professional testing and assessment of skills, abilities, learning and achievement; downloadable interactive multimedia educational software programs for mobile platforms featuring instruction in English language learning; downloadable electronic publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable educational software in the nature of a mobile application for testing language proficiency and featuring instruction in the field of language for preparing for and practicing tests of language proficiency and for vocabulary enrichment; downloadable computer software for conducting tests for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for administrating and proctoring practice tests, generating study guides for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, study guides, pamphlets, posters, rosters, printed reports, printed vouchers, and printed summaries and papers featuring information pertaining to language proficiency; printed publications, namely, books and booklets used for preparing for and practicing standardized tests of language proficiency; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates. Educational testing services, namely, creating, administering, scoring and reporting a paper-based, computer-based and internet-based language proficiency test; conducting professional development workshops in the field of language instruction and learning and language proficiency test preparation; educational testing services, namely, providing test score reporting services; educational assessment services, namely, providing essay scores and writing skills evaluations to students and teachers via the internet; education services, namely, providing online and in-person education courses and workshops for teachers and educators in the field of English language learners, language instruction and English language proficiency testing; education services, namely, providing test preparation services, namely, preparing, administering, and scoring academic for tests for English language proficiency; providing online non-downloadable pre-recorded videos related to tests of English language proficiency; providing online non-downloadable test preparation materials in the nature of e-books, study guides, teaching review books, e-books featuring practice exams, and test score reports in the field of English language proficiency testing; Online non-downloadable journals and video journals, namely, blogs and vlogs featuring non-downloadable publications in the nature of research articles and news articles, and online non-downloadable videos, all featuring information in the field of English language learning; Providing online training via instruction courses, eLearning modules in the nature of interactive lessons, interactive educational activities, virtual educational worlds, and online non-downloadable videos, all in the field of improving learning, writing, reading and English language speaking skills Providing temporary use of non-downloadable online software for administering Internet-based language proficiency tests; providing temporary use of non-downloadable on-line software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of non-downloadable software featuring technology for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation

Goods & Services

(1) Audio and video recordings, pre-recorded computer programs and computer programs downloadable from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, and for use in preparing educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for paraprofessional licensure and paraprofessional certification, education, educational research and standardized testing; interactive computer software to assist in curriculum development, curriculum management and the development of instructional programs for teachers, schools, school districts and educational service regions; downloadable publications and e-books for use in preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and in research educational programs and services; computer search engine software; downloadable computer software featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating workplace readiness for paraeducators; downloadable software in the nature of a mobile application featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating workplace readiness for paraeducators; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of workplace readiness for paraeducators. (2) Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, guides, pamphlets, posters, rosters, printed reports, vouchers, summaries and papers pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books and booklets used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement, aptitude, and language proficiency for paraeducators; printed publications, namely, books, booklets, study guides, and instructional manuals in the field of test preparation, test administration and test scoring for a series of examinations for paraprofessional licensure and paraprofessional certification; printed tests in the field of teacher licensure and teacher certification; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and the testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating workplace readiness for paraeducators. (1) Providing test registration services; online retail store services featuring educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness. (2) Creating, administering and scoring tests of academic skills, abilities and learning; administering educational tests to measure information and communication technology proficiency; test development, test administration and test scoring services for a series of examinations for paraprofessional licensure and paraprofessional certification; conducting seminars, webinars and workshops in the field of test preparation, paraprofessional licensure and paraprofessional certification; consultation in the fields of educational testing and assessment; providing educational information about testing, namely, in the field of education; organizing in-person educational forums and conducting training workshops and seminars on graduate schools and graduate school admissions examinations for paraeducators; providing graduate school educational information by computer for students and educational institutions; conducting professional development workshops for paraeducators; providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational services, namely, curriculum and instruction design and implementation services; analysis and assessment of educational curriculum; training and educational consultation services in the field of elementary, middle and high school education; conducting research and studies with respect to educational testing and test theory; providing an online database featuring graduate school information and guidance for students and educational institutions; providing graduate school guidance, assessment and placement services; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing an interactive website providing educators, parents and students with educational information and counseling about standardized tests; providing weblinks to informational sites of others regarding educational issues; publication of booklets, leaflets and brochures regarding standardized testing; providing written text editing delivered via the internet; providing an online searchable database featuring educational research and validity studies in the field of educational achievement, aptitude and assessment; providing online educational assessments; educational services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of workplace readiness for paraeducators; providing test score reporting services; educational services, namely, providing essay scores and writing skills evaluations to students and teachers via the internet; educational services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict paraeducators' success; educational services, namely, providing internships and fellowships in the field of educational research. (3) Providing temporary use of non-downloadable online software for the administration of a series of examinations for paraprofessional licensure and paraprofessional certification;; conducting research and validity studies in the field of educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment; providing temporary use of non-downloadable on-line software for an Internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating workplace readiness for paraeducators; providing temporary use of non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating workplace readiness for paraeducators; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments in the field of education.

Goods & Services

Providing online test registration services; online retail store services featuring educational materials and job and career readiness materials; consultation in the field of testing to determine professional competency; business consultation in the field of testing to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness; Career placement services for graduate students Audio and video recordings, pre-recorded computer programs and computer programs all downloadable from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, and for use in preparing educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for paraprofessional licensure and paraprofessional certification, education, educational research and standardized testing; downloadable interactive computer software to assist in curriculum development, curriculum management and the development of instructional programs for teachers, schools, school districts and educational service regions; downloadable electronic publications in the nature of booklets, books, pamphlets, newsletters, brochures and score reports and downloadable e-books for use in preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and in research educational programs and services; downloadable computer search engine software; downloadable computer software featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating workplace readiness for paraeducators; downloadable software in the nature of a mobile application featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating workplace readiness for paraeducators; downloadable electronic publications, namely, certificates for use as awards, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of workplace readiness for paraeducators Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, guides, pamphlets, posters, rosters, printed reports, vouchers, summaries and papers pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books and booklets used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement, aptitude, and language proficiency for paraeducators; printed publications, namely, books, booklets, study guides, and instructional manuals in the field of test preparation, test administration and test scoring for a series of examinations for paraprofessional licensure and paraprofessional certification; printed tests in the field of teacher licensure and teacher certification; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and the testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating workplace readiness for paraeducators Preparing, administering, and scoring academic standardized tests of academic skills, abilities and learning; educational testing to measure information and communication technology proficiency; Preparing, administering, and scoring academic standardized tests for paraprofessional licensure and paraprofessional certification; conducting seminars, non-downloadable webinars and workshops in the field of test preparation, paraprofessional licensure and paraprofessional certification; consultation in the fields of educational testing and assessment; providing educational information about educational testing; organizing in-person educational forums and conducting training workshops and seminars on graduate schools and graduate school admissions examinations for paraeducators; providing information on graduate school education by computer for students and educational institutions; conducting professional development workshops for paraeducators; providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational services, namely, developing curriculum for educators; analysis and assessment of educational curriculum for use by paraprofessional educators; training and educational consultation services in the field of elementary, middle and high school educational systems; conducting research in the field of educational testing; providing an online database featuring information on graduate school education; educational services, namely, providing academic performance evaluation, guidance, and monitoring for graduate students; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; educational counseling services to assist students in the field of standardized testing in planning and preparing for further education; providing links to informational websites of others regarding educational information Providing temporary use of non-downloadable online software for the administration of a series of examinations for paraprofessional licensure and paraprofessional certification; providing an online searchable database featuring educational research and validity studies in the field of educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment; providing temporary use of non-downloadable on-line software for an Internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating workplace readiness for paraeducators; providing temporary use of online non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating workplace readiness for paraeducators; providing temporary use of online non-downloadable software that identifies job candidates who are likely to succeed in particular work environments in the field of education

Abstract

Data such as unstructured text is received that includes a sequence of sentences. This received data is then tokenized into a plurality of tokens. The received data is segmented using a hierarchical transformer network model including a token transformer, a sentence transformer, and a segmentation classifier. The token transformer contextualizes tokens within sentences and yields sentence embeddings. The sentences transformer contextualizes sentence representations based on the sentence embedddings. The segmentation classifier predicts segments of the received data based on the contextualized sentence representations. Data can be provided which characterizes the segmentation of the received data. Related apparatus, systems, techniques and articles are also described.

IPC Classes  ?

• G06F 40/284 - Lexical analysis, e.g. tokenisation or collocates
• G06F 18/214 - Generating training patternsBootstrap methods, e.g. bagging or boosting
• G06N 3/04 - Architecture, e.g. interconnection topology
• G06N 3/08 - Learning methods

Goods & Services

(1) Audio and video recordings, pre-recorded computer programs and downloadable computer programs from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research, standardized testing, and professional testing and assessment of skills, abilities, learning and achievement; downloadable software for use in database management for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; downloadable electronic publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books in the field of preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and research of educational programs and services; downloadable computer software for conducting tests for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; downloadable computer search engine software; downloadable computer software featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness. (2) Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, study guides, pamphlets, posters, rosters, printed reports, printed vouchers, and printed summaries and papers featuring information pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and the testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness. (1) Providing test registration services for educational administration purposes; online retail store services featuring educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness. (2) Educational testing services, namely, creating, administering and scoring tests of academic skills, abilities and learning; educational testing services, namely, administering educational tests to measure information and communication technology proficiency; educational testing services, namely, preparing, administering, scoring and reporting a series of graduate school admissions examinations; consultation in the fields of educational testing and assessment; providing educational information about testing, namely, in the field of education; arranging and conducting in-person educational forums, training workshops and seminars on graduate schools and graduate school admissions examinations; providing graduate school educational information, namely, providing information in the field of graduate school education by computer for students and educational institutions; conducting professional development workshops in the field of language instruction and learning and language proficiency test preparation; educational services, namely, providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational consulting and training services in the field of educational practices that assist teachers and administrators in evaluating collected student performance data and designing and implementing standards-based instruction based thereon to improve academic achievement; Providing educational assessment and academic performance evaluation, namely, educational assessment of student achievement, proficiency and skill level based on established state educational standards; providing an online computer database featuring graduate school information and guidance for students and educational institutions; educational counseling services to assist students in planning and preparing for further education in the nature of providing graduate school guidance, providing educational assessment services; educational services, namely, providing class placement services; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing an interactive website providing educators, parents and students with educational information and educational counseling services about standardized tests and K-12 education; providing an Internet website portal featuring web links to informational sites of others regarding educational issues; providing an online searchable database featuring educational research and validity studies in the field of educational achievement, aptitude and assessment; providing online educational assessment services; educational testing services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; educational testing services, namely, providing test score reporting services; educational assessment services, namely, providing essay scores and writing skills evaluations to students and teachers via the internet; educational assessment services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict college students' success; educational services, namely, providing internships in the field of educational research; conducting fellowship training programs in the field of educational research; research and validity studies in the field of education featuring topics regarding educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment. (3) Providing temporary use of non-downloadable on-line software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable on-line software for an Internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing temporary use of non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing a website featuring temporary use of non-downloadable software that enables users to take practice exams to determine readiness for high school-level proficiency and higher education and workplace readiness examinations; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of non-downloadable software featuring technology for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing a website featuring a search engine for measuring, scoring and reporting on workplace productivity, work skills and occupational proficiencies and workplace adaptation.

Goods & Services

Audio and video recordings, pre-recorded computer programs and downloadable computer programs from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research, standardized testing, and professional testing and assessment of skills, abilities, learning and achievement; downloadable software for use in database management for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; downloadable electronic publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books in the field of preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and research of educational programs and services; downloadable computer software for conducting tests for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; downloadable computer search engine software; downloadable computer software featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness. Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, study guides, pamphlets, posters, rosters, printed reports, printed vouchers, and printed summaries and papers featuring information pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and the testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness. Educational testing services, namely, creating, administering and scoring tests of academic skills, abilities and learning; educational testing services, namely, administering educational tests to measure information and communication technology proficiency; educational testing services, namely, preparing, administering, scoring and reporting a series of graduate school admissions examinations; consultation in the fields of educational testing and assessment; providing educational information about testing, namely, in the field of education; arranging and conducting in-person educational forums, training workshops and seminars on graduate schools and graduate school admissions examinations; providing graduate school educational information, namely, providing information in the field of graduate school education by computer for students and educational institutions; conducting professional development workshops in the field of language instruction and learning and language proficiency test preparation; educational services, namely, providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational consulting and training services in the field of educational practices that assist teachers and administrators in evaluating collected student performance data and designing and implementing standards-based instruction based thereon to improve academic achievement; Providing educational assessment and academic performance evaluation, namely, educational assessment of student achievement, proficiency and skill level based on established state educational standards; providing an online computer database featuring graduate school information and guidance for students and educational institutions; educational counseling services to assist students in planning and preparing for further education in the nature of providing graduate school guidance, providing educational assessment services; educational services, namely, providing class placement services; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing an interactive website providing educators, parents and students with educational information and educational counseling services about standardized tests and K-12 education; providing an Internet website portal featuring web links to informational sites of others regarding educational issues; providing an online searchable database featuring educational research and validity studies in the field of educational achievement, aptitude and assessment; providing online educational assessment services; educational testing services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; educational testing services, namely, providing test score reporting services; educational assessment services, namely, providing essay scores and writing skills evaluations to students and teachers via the internet; educational assessment services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict college students' success; educational services, namely, providing internships in the field of educational research; conducting fellowship training programs in the field of educational research; research and validity studies in the field of education featuring topics regarding educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment. Providing temporary use of non-downloadable on-line software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable on-line software for an Internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing temporary use of non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing a website featuring temporary use of non-downloadable software that enables users to take practice exams to determine readiness for high school-level proficiency and higher education and workplace readiness examinations; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of non-downloadable software featuring technology for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing a website featuring a search engine for measuring, scoring and reporting on workplace productivity, work skills and occupational proficiencies and workplace adaptation.

Goods & Services

Providing testing administration services for others, namely, on-line test registration services for educational administration purposes; online retail store services featuring educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency, namely, for career placement purposes; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness for career placement purposes Audio and video recordings featuring lectures on preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; pre-recorded computer programs and downloadable computer programs from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research, standardized testing, and professional testing and assessment of skills, abilities, learning and achievement; downloadable computer software for use in database management for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; downloadable electronic publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books in the field of preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and research of educational programs and services; downloadable computer software for conducting tests for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; downloadable computer search engine software; downloadable computer software for use in education featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application for use in education featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, study guides, pamphlets, posters, rosters, printed reports, printed vouchers, and printed summaries and papers featuring information pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed test forms for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and the testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness Educational testing services, namely, creating, administering and scoring tests of academic skills, abilities and learning; educational testing services, namely, administering educational tests to measure information and communication technology proficiency; educational testing services, namely, preparing, administering, scoring and reporting a series of graduate school admissions examinations; consultation in the fields of educational testing and assessment; providing educational information about educational testing, namely, in the field of education; arranging and conducting in-person educational forums, training workshops and seminars on graduate schools and graduate school admissions examinations; providing graduate school educational information, namely, providing information in the field of graduate school education by computer for students and educational institutions; conducting professional development educational workshops in the field of language instruction and learning and language proficiency test preparation; educational services, namely, providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational consulting and training services in the field of educational practices that assist teachers and administrators in evaluating collected student performance data and designing and implementing standards-based instruction based thereon to improve academic achievement; Providing educational assessment and academic performance evaluation, namely, educational assessment of student achievement, proficiency and skill level based on established state educational standards; providing an online computer database featuring graduate school admissions information and guidance for students and educational institutions; educational counseling services to assist students in planning and preparing for further education in the nature of providing graduate school guidance, providing educational assessment services; educational services, namely, providing class placement services; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing an interactive website providing educators, parents and students with educational information and educational counseling services about standardized tests and K-12 education; providing an Internet website portal featuring web links to informational sites of others regarding education issues; providing an online searchable database featuring education research and validity studies in the field of educational achievement, aptitude and assessment; providing online educational assessment services; educational testing services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; educational testing services, namely, providing test score reporting services; educational assessment services, namely, providing essay scores and writing skills evaluations to students and teachers via the internet; educational assessment services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict college students' success; educational services, namely, providing internships in the field of educational research; conducting fellowship training programs in the field of educational research; conducting educational research and validity studies in the field of education featuring topics regarding educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment Providing temporary use of non-downloadable on-line software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable on-line software for an Internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing temporary use of online non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing a website featuring temporary use of non-downloadable software that enables users to take practice exams to determine readiness for high school-level proficiency and higher education and workplace readiness examinations; providing temporary use of online non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of online non-downloadable software featuring technology for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing a website featuring a search engine for measuring, scoring and reporting on workplace productivity, work skills and occupational proficiencies and workplace adaptation

Goods & Services

(1) Audio and video recordings, pre-recorded computer programs and downloadable computer programs from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research, standardized testing, and professional testing and assessment of skills, abilities, learning and achievement; downloadable software for use in database management for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; downloadable electronic publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books in the field of preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and research of educational programs and services; downloadable computer software for conducting tests for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; downloadable computer search engine software; downloadable computer software featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness. (2) Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, study guides, pamphlets, posters, rosters, printed reports, printed vouchers, and printed summaries and papers featuring information pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and the testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness. (1) Providing test registration services for educational administration purposes; online retail store services featuring educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness. (2) Educational testing services, namely, creating, administering and scoring tests of academic skills, abilities and learning; educational testing services, namely, administering educational tests to measure information and communication technology proficiency; educational testing services, namely, preparing, administering, scoring and reporting a series of graduate school admissions examinations; consultation in the fields of educational testing and assessment; providing educational information about testing, namely, in the field of education; arranging and conducting in-person educational forums, training workshops and seminars on graduate schools and graduate school admissions examinations; providing graduate school educational information, namely, providing information in the field of graduate school education by computer for students and educational institutions; conducting professional development workshops in the field of language instruction and learning and language proficiency test preparation; educational services, namely, providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational consulting and training services in the field of educational practices that assist teachers and administrators in evaluating collected student performance data and designing and implementing standards-based instruction based thereon to improve academic achievement; Providing educational assessment and academic performance evaluation, namely, educational assessment of student achievement, proficiency and skill level based on established state educational standards; providing an online computer database featuring graduate school information and guidance for students and educational institutions; educational counseling services to assist students in planning and preparing for further education in the nature of providing graduate school guidance, providing educational assessment services; educational services, namely, providing class placement services; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing an interactive website providing educators, parents and students with educational information and educational counseling services about standardized tests and K-12 education; providing an Internet website portal featuring web links to informational sites of others regarding educational issues; providing an online searchable database featuring educational research and validity studies in the field of educational achievement, aptitude and assessment; providing online educational assessment services; educational testing services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; educational testing services, namely, providing test score reporting services; educational assessment services, namely, providing essay scores and writing skills evaluations to students and teachers via the internet; educational assessment services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict college students' success; educational services, namely, providing internships in the field of educational research; conducting fellowship training programs in the field of educational research; research and validity studies in the field of education featuring topics regarding educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment. (3) Providing temporary use of non-downloadable on-line software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable on-line software for an Internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing temporary use of non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing a website featuring temporary use of non-downloadable software that enables users to take practice exams to determine readiness for high school-level proficiency and higher education and workplace readiness examinations; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of non-downloadable software featuring technology for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing a website featuring a search engine for measuring, scoring and reporting on workplace productivity, work skills and occupational proficiencies and workplace adaptation.

Goods & Services

Audio and video recordings, pre-recorded computer programs and downloadable computer programs from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research, standardized testing, professional testing and assessment of skills, abilities, learning and achievement; downloadable software for use in database management for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; downloadable electronic publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books in the field of preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and research of educational programs and services; downloadable computer software for conducting tests for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; downloadable computer search engine software; downloadable computer software featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness. Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, study guides, pamphlets, posters, rosters, printed reports, printed vouchers, and printed summaries and papers featuring information pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books and booklets used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement, aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and the testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness. Online retail store services featuring educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness. Educational testing services, namely, creating, administering and scoring tests of academic skills, abilities and learning; educational testing services, namely, administering educational tests to measure information and communication technology proficiency; educational testing services, namely, preparing, administering, scoring and reporting a series of graduate school admissions examinations; consultation in the fields of educational testing and assessment; providing educational information about testing, namely, in the field of education; arranging and conducting in-person educational forums, training workshops and seminars on graduate schools and graduate school admissions examinations; providing graduate school educational information, namely, providing information in the field of graduate school education by computer for students and educational institutions; conducting professional development workshops in the field of language instruction and learning and language proficiency test preparation; educational services, namely, providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational consulting and training services in the field of educational practices that assist teachers and administrators in evaluating collected student performance data and designing and implementing standards-based instruction based thereon to improve academic achievement; educational services, namely, developing curriculum and instruction design and implementation services in the nature of developing curriculum for educators; educational services, namely, analysis and assessment of educational curriculum, namely, providing educational assessment services of educational curriculum; providing training for educators and other individuals in the field of elementary, middle and high school education; educational consultation services in the field of elementary, middle and high school education; providing educational assessment and academic performance evaluation, namely, educational assessment of student achievement, proficiency and skill level based on established state educational standards; providing an online computer database featuring graduate school information and guidance for students and educational institutions; educational counseling services to assist students in planning and preparing for further education in the nature of providing graduate school guidance, providing educational assessment services; educational services, namely, providing class placement services; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing an interactive website providing educators, parents and students with educational information and educational counseling services about standardized tests and K-12 education; providing an Internet website portal featuring web links to informational sites of others regarding educational issues; providing an online searchable database featuring educational research and validity studies in the field of educational achievement, aptitude and assessment; providing online educational assessment services; educational testing services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; educational testing services, namely, providing test score reporting services; educational assessment services, namely, providing essay scores and writing skills evaluations to students and teachers via the internet; educational assessment services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict college students' success; educational services, namely, providing internships in the field of educational research; conducting fellowship training programs in the field of educational research; research and validity studies in the field of education featuring topics regarding educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment. Providing temporary use of non-downloadable on-line software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable on-line software for an Internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing temporary use of non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing a website featuring temporary use of non-downloadable software that enables users to take practice exams to determine readiness for high school-level proficiency and higher education and workplace readiness examinations; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of non-downloadable software featuring technology for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing a website featuring a search engine for measuring, scoring and reporting on workplace productivity, work skills and occupational proficiencies and workplace adaptation; Providing test registration services for educational administration purposes.

Goods & Services

Audio and video recordings, pre-recorded computer programs and downloadable computer programs from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research, standardized testing, professional testing and assessment of skills, abilities, learning and achievement; downloadable software for use in database management for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; downloadable electronic publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books in the field of preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and research of educational programs and services; downloadable computer software for conducting tests for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; downloadable computer search engine software; downloadable computer software featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness. Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, study guides, pamphlets, posters, rosters, printed reports, printed vouchers, and printed summaries and papers featuring information pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and the testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness. Online retail store services featuring educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness. Educational testing services, namely, creating, administering and scoring tests of academic skills, abilities and learning; educational testing services, namely, administering educational tests to measure information and communication technology proficiency; educational testing services, namely, preparing, administering, scoring and reporting a series of graduate school admissions examinations; consultation in the fields of educational testing and assessment; providing educational information about testing, namely, in the field of education; arranging and conducting in-person educational forums, training workshops and seminars on graduate schools and graduate school admissions examinations; providing graduate school educational information, namely, providing information in the field of graduate school education by computer for students and educational institutions; conducting professional development workshops in the field of language instruction and learning and language proficiency test preparation; educational services, namely, providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational consulting and training services in the field of educational practices that assist teachers and administrators in evaluating collected student performance data and designing and implementing standards-based instruction based thereon to improve academic achievement; Providing educational assessment and academic performance evaluation, namely, educational assessment of student achievement, proficiency and skill level based on established state educational standards; providing an online computer database featuring graduate school information and guidance for students and educational institutions; educational counseling services to assist students in planning and preparing for further education in the nature of providing graduate school guidance, providing educational assessment services; educational services, namely, providing class placement services; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing an interactive website providing educators, parents and students with educational information and educational counseling services about standardized tests and K-12 education; providing an Internet website portal featuring web links to informational sites of others regarding educational issues; providing an online searchable database featuring educational research and validity studies in the field of educational achievement, aptitude and assessment; providing online educational assessment services; educational testing services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; educational testing services, namely, providing test score reporting services; educational assessment services, namely, providing essay scores and writing skills evaluations to students and teachers via the internet; educational assessment services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict college students' success; educational services, namely, providing internships in the field of educational research; conducting fellowship training programs in the field of educational research; research and validity studies in the field of education featuring topics regarding educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment. Providing temporary use of non-downloadable on-line software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable on-line software for an Internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing temporary use of non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing a website featuring temporary use of non-downloadable software that enables users to take practice exams to determine readiness for high school-level proficiency and higher education and workplace readiness examinations; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of non-downloadable software featuring technology for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing a website featuring a search engine for measuring, scoring and reporting on workplace productivity, work skills and occupational proficiencies and workplace adaptation; Providing test registration services for educational administration purposes.

Goods & Services

(1) Audio and video recordings, pre-recorded computer programs and downloadable computer programs from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research, standardized testing, professional testing and assessment of skills, abilities, learning and achievement; downloadable software for use in database management for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; downloadable electronic publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books in the field of preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and research of educational programs and services; downloadable computer software for conducting tests for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; downloadable computer search engine software; downloadable computer software featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness. (2) Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, study guides, pamphlets, posters, rosters, printed reports, printed vouchers, and printed summaries and papers featuring information pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books and booklets used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement, aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and the testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness. (1) Providing test registration services for educational administration purposes; online retail store services featuring educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness. (2) Educational testing services, namely, creating, administering and scoring tests of academic skills, abilities and learning; educational testing services, namely, administering educational tests to measure information and communication technology proficiency; educational testing services, namely, preparing, administering, scoring and reporting a series of graduate school admissions examinations; consultation in the fields of educational testing and assessment; providing educational information about testing, namely, in the field of education; arranging and conducting in-person educational forums, training workshops and seminars on graduate schools and graduate school admissions examinations; providing graduate school educational information, namely, providing information in the field of graduate school education by computer for students and educational institutions; conducting professional development workshops in the field of language instruction and learning and language proficiency test preparation; educational services, namely, providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational consulting and training services in the field of educational practices that assist teachers and administrators in evaluating collected student performance data and designing and implementing standards-based instruction based thereon to improve academic achievement; educational services, namely, developing curriculum and instruction design and implementation services in the nature of developing curriculum for educators; educational services, namely, analysis and assessment of educational curriculum, namely, providing educational assessment services of educational curriculum; providing training for educators and other individuals in the field of elementary, middle and high school education; educational consultation services in the field of elementary, middle and high school education; providing educational assessment and academic performance evaluation, namely, educational assessment of student achievement, proficiency and skill level based on established state educational standards; providing an online computer database featuring graduate school information and guidance for students and educational institutions; educational counseling services to assist students in planning and preparing for further education in the nature of providing graduate school guidance, providing educational assessment services; educational services, namely, providing class placement services; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing an interactive website providing educators, parents and students with educational information and educational counseling services about standardized tests and K-12 education; providing an Internet website portal featuring web links to informational sites of others regarding educational issues; providing an online searchable database featuring educational research and validity studies in the field of educational achievement, aptitude and assessment; providing online educational assessment services; educational testing services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; educational testing services, namely, providing test score reporting services; educational assessment services, namely, providing essay scores and writing skills evaluations to students and teachers via the internet; educational assessment services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict college students' success; educational services, namely, providing internships in the field of educational research; conducting fellowship training programs in the field of educational research; research and validity studies in the field of education featuring topics regarding educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment. (3) Providing temporary use of non-downloadable on-line software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable on-line software for an Internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing temporary use of non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing a website featuring temporary use of non-downloadable software that enables users to take practice exams to determine readiness for high school-level proficiency and higher education and workplace readiness examinations; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of non-downloadable software featuring technology for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing a website featuring a search engine for measuring, scoring and reporting on workplace productivity, work skills and occupational proficiencies and workplace adaptation.

Goods & Services

Providing test registration services for educational administration purposes; online retail store services featuring educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness Recorded computer programs and downloadable computer programs accessible from a global computer network for use in preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, e-books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research, standardized testing, and professional testing and assessment of skills, abilities, learning and achievement; downloadable software for use in database management for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; downloadable electronic publications, namely, tests, e-books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books in the field of preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and research of educational programs and services; downloadable computer software for conducting tests, for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; downloadable computer search engine software; downloadable computer software for use in testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application featuring software for use in testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, study guides, pamphlets, posters, rosters, printed reports, printed vouchers, and printed summaries and papers featuring information pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed instructional materials in the nature of printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and the testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness Educational testing services, namely, creating, administering and scoring tests of academic skills, abilities and learning; educational testing services, namely, administering educational tests to measure information and communication technology proficiency; educational testing services, namely, preparing, administering, scoring and reporting a series of graduate school admissions examinations; consultation in the fields of educational testing and assessment; providing educational information about testing, namely, in the field of education; arranging and conducting in person educational forums, training workshops and seminars on graduate schools and graduate school admissions examinations; providing educational information, namely, providing information in the field of graduate school education by computer for students and educational institutions; Educational services, namely, conducting professional development workshops in the field of language instruction and learning and language proficiency test preparation; educational services, namely, providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational consulting and training services in the field of educational practices that assist teachers and administrators in evaluating collected student performance data and designing and implementing standards-based instruction based thereon to improve academic achievement; Providing educational assessment services and academic performance evaluation, namely, educational assessment of student achievement, proficiency and skill level based on established state educational standards; providing an online computer database featuring graduate school information and guidance for students and educational institutions; educational counseling services to assist students in planning and preparing for further education in the nature of providing graduate school guidance, providing educational assessment services; educational services, namely, providing class placement services, namely, providing educational assessment services of individual students to determine proficiency for placement in advanced classes; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing an Internet website portal featuring web links to informational sites of others regarding educational issues; providing an online searchable database featuring educational research and validity studies in the field of educational achievement, aptitude and assessment; providing online educational assessment services; educational testing services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; educational testing services, namely, providing test score reporting services; educational assessment services, namely, providing essay scores and writing skills evaluations to students and teachers via the internet; educational assessment services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict college students' success; educational services, namely, providing internships in the field of educational research; conducting fellowship training programs in the field of educational research; research studies in the field of education featuring topics regarding educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment Providing temporary use of non-downloadable on-line software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable on-line software for an Internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing temporary use of non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing a website featuring temporary use of non-downloadable software that enables users to take practice exams to determine readiness for high school-level proficiency and higher education and workplace readiness examinations; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of non-downloadable software featuring technology for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing a website featuring a search engine for measuring, scoring and reporting on workplace productivity, work skills and occupational proficiencies and workplace adaptation

Goods & Services

Providing test registration services for educational administration purposes; online retail store services featuring educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness Audio and video recordings, pre-recorded computer programs and downloadable computer programs from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research, standardized testing, and professional testing and assessment of skills, abilities, learning and achievement; downloadable software for use in database management for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; downloadable electronic publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books in the field of preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and research of educational programs and services; downloadable computer software for conducting tests for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; downloadable computer search engine software; downloadable computer software featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, study guides, pamphlets, posters, rosters, printed reports, printed vouchers, and printed summaries and papers featuring information pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books and booklets used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement, aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and the testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness educational testing services, namely, creating, administering and scoring tests of academic skills, abilities and learning; educational testing services, namely, administering educational tests to measure information and communication technology proficiency; educational testing services, namely, preparing, administering, scoring and reporting a series of graduate school admissions examinations; consultation in the fields of educational testing and assessment; providing educational information about testing, namely, in the field of education; arranging and conducting in-person educational forums, training workshops and seminars on graduate schools and graduate school admissions examinations; providing graduate school educational information, namely, providing information in the field of graduate school education by computer for students and educational institutions; conducting professional development workshops in the field of language instruction and learning and language proficiency test preparation; educational services, namely, providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational consulting and training services in the field of educational practices that assist teachers and administrators in evaluating collected student performance data and designing and implementing standards-based instruction based thereon to improve academic achievement; educational services, namely, developing curriculum and instruction design and implementation services in the nature of developing curriculum for educators; educational services, namely, analysis and assessment of educational curriculum, namely, providing educational assessment services of educational curriculum; providing training for educators and other individuals in the field of elementary, middle and high school education; educational consultation services in the field of elementary, middle and high school education; providing educational assessment and academic performance evaluation, namely, educational assessment of student achievement, proficiency and skill level based on established state educational standards; providing an online computer database featuring graduate school information and guidance for students and educational institutions; educational counseling services to assist students in planning and preparing for further education in the nature of providing graduate school guidance, providing educational assessment services; educational services, namely, providing class placement services; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing an interactive website providing educators, parents and students with educational information and educational counseling services about standardized tests and K-12 education; providing an Internet website portal featuring web links to informational sites of others regarding educational issues; providing an online searchable database featuring educational research and validity studies in the field of educational achievement, aptitude and assessment; providing online educational assessment services; educational testing services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; educational testing services, namely, providing test score reporting services; educational assessment services, namely, providing essay scores and writing skills evaluations to students and teachers via the internet; educational assessment services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict college students' success; educational services, namely, providing internships in the field of educational research; conducting fellowship training programs in the field of educational research; research and validity studies in the field of education featuring topics regarding educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment Providing temporary use of non-downloadable on-line software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable on-line software for an Internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing temporary use of non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing a website featuring temporary use of non-downloadable software that enables users to take practice exams to determine readiness for high school-level proficiency and higher education and workplace readiness examinations; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of non-downloadable software featuring technology for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing a website featuring a search engine for measuring, scoring and reporting on workplace productivity, work skills and occupational proficiencies and workplace adaptation

Goods & Services

(1) Audio and video recordings, pre-recorded computer programs and computer programs downloadable from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research and standardized testing; interactive computer software to assist in curriculum development, curriculum management and the development of instructional programs for teachers, schools, school districts and educational service regions; database management software for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; interactive multimedia software programs for mobile platforms for English language learning; downloadable publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books for use in preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and in research educational programs and services; downloadable software in the nature of a mobile application featuring content for testing language proficiency, for preparing for and practicing tests of language proficiency and for vocabulary enrichment; downloadable computer based tests for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; computer search engine software; downloadable computer software featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness (2) Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, guides, pamphlets, posters, rosters, printed reports, vouchers, summaries and papers pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books and booklets used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement, aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations; printed publications, namely, books, booklets, study guides, and instructional manuals in the field of test preparation, test administration and test scoring for a series of examinations for teacher licensure and teacher certification; printed tests in the field of teacher licensure and teacher certification; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and the testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness (1) Providing test registration services; online retail store services connected with the sale of educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness (2) Creating, administering, scoring and reporting a paper-based, computer-based and internet-based language proficiency test; creating, administering and scoring tests of academic skills, abilities and learning; administering educational tests to measure information and communication technology proficiency; preparing, administering, scoring and reporting a series of graduate school admissions examinations; test development, test administration and test scoring services for a series of examinations for teacher licensure and teacher certification; conducting seminars, webinars and workshops in the field of test preparation, teacher licensure and teacher certification; consultation in the fields of educational testing and assessment; providing educational information about testing, namely, in the field of education; organizing in-person educational forums and conducting training workshops and seminars on graduate schools and graduate school admissions examinations; providing graduate school educational information by computer for students and educational institutions; conducting professional development workshops in the field of language instruction and learning and language proficiency test preparation; providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational consulting and training services in the field of educational practices that assist teachers and administrators in evaluating collected student performance data and designing and implementing standards-based instruction based thereon to improve academic achievement; educational services, namely, curriculum and instruction design and implementation services; analysis and assessment of educational curriculum; training and educational consultation services in the field of elementary, middle and high school education; assessment and evaluation of student achievement, proficiency and skill level based on established state educational standards; development of research-based diagnostic tools, namely, printed materials, to assist schools and school districts evaluate their curriculum and instructional programs to ensure all students meet established state educational standards; conducting research and studies with respect to educational testing and test theory; providing graduate school information and guidance for students and educational institutions via an online database; providing graduate school guidance, assessment and placement services; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing an interactive website providing educators, parents and students with educational information and counseling about standardized tests and K-12 education; providing weblinks to informational sites of others regarding educational issues; publication of booklets, leaflets and brochures regarding K-12 education and standardized testing; providing written text editing delivered via the internet; providing an online searchable database featuring educational research and validity studies in the field of educational achievement, aptitude and assessment; providing online educational assessments; educational services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing test score reporting services; educational services, namely, providing essay scores and writing skills evaluations to students and teachers via the internet; educational services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict college students' success; educational services, namely, providing internships and fellowships in the field of educational research (3) Providing temporary use of non-downloadable online software for an Internet-based language proficiency test; providing temporary use of non-downloadable online software for the administration of a series of examinations for teacher licensure and teacher certification; development of research-based diagnostic tools, namely, computer software, to assist schools and school districts evaluate their curriculum and instructional programs to ensure all students meet established state educational standards; conducting research and validity studies in the field of educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment; providing temporary use of non-downloadable on-line software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable on-line software for an Internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing temporary use of non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing a website featuring temporary use of non-downloadable software that enables users to take practice exams to determine readiness for high school-level proficiency and higher education and workplace readiness examinations; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of non-downloadable technology for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing a website featuring a search engine for measuring, scoring and reporting on workplace

Goods & Services

Audio and video recordings, pre-recorded computer programs and computer programs downloadable from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research and standardized testing; interactive computer software to assist in curriculum development, curriculum management and the development of instructional programs for teachers, schools, school districts and educational service regions; database management software for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; interactive multimedia software programs for mobile platforms for English language learning; downloadable publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books for use in preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and in research educational programs and services; downloadable software in the nature of a mobile application featuring content for testing language proficiency, for preparing for and practicing tests of language proficiency and for vocabulary enrichment; downloadable computer based tests for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; computer search engine software; downloadable computer software featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness. Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, guides, pamphlets, posters, rosters, printed reports, vouchers, summaries and papers pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books and booklets used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement, aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations; printed publications, namely, books, booklets, study guides, and instructional manuals in the field of test preparation, test administration and test scoring for a series of examinations for teacher licensure and teacher certification; printed tests in the field of teacher licensure and teacher certification; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and the testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness. Providing test registration services; online retail store services connected with the sale of educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness. Creating, administering, scoring and reporting a paper-based, computer-based and internet-based language proficiency test; creating, administering and scoring tests of academic skills, abilities and learning; administering educational tests to measure information and communication technology proficiency; preparing, administering, scoring and reporting a series of graduate school admissions examinations; test development, test administration and test scoring services for a series of examinations for teacher licensure and teacher certification; conducting seminars, webinars and workshops in the field of test preparation, teacher licensure and teacher certification; consultation in the fields of educational testing and assessment; providing educational information about testing, namely, in the field of education; organizing in-person educational forums and conducting training workshops and seminars on graduate schools and graduate school admissions examinations; providing graduate school educational information by computer for students and educational institutions; conducting professional development workshops in the field of language instruction and learning and language proficiency test preparation; providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational consulting and training services in the field of educational practices that assist teachers and administrators in evaluating collected student performance data and designing and implementing standards-based instruction based thereon to improve academic achievement; educational services, namely, curriculum and instruction design and implementation services; analysis and assessment of educational curriculum; training and educational consultation services in the field of elementary, middle and high school education; assessment and evaluation of student achievement, proficiency and skill level based on established state educational standards; development of research-based diagnostic tools, namely, printed materials, to assist schools and school districts evaluate their curriculum and instructional programs to ensure all students meet established state educational standards; conducting research and studies with respect to educational testing and test theory; providing graduate school information and guidance for students and educational institutions via an online database; providing graduate school guidance, assessment and placement services; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing an interactive website providing educators, parents and students with educational information and counseling about standardized tests and K-12 education; providing weblinks to informational sites of others regarding educational issues; publication of booklets, leaflets and brochures regarding K-12 education and standardized testing; providing written text editing delivered via the internet; providing an online searchable database featuring educational research and validity studies in the field of educational achievement, aptitude and assessment; providing online educational assessments; educational services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing test score reporting services; educational services, namely, providing essay scores and writing skills evaluations to students and teachers via the internet; educational services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict college students' success; educational services, namely, providing internships and fellowships in the field of educational research. Providing temporary use of non-downloadable online software for an Internet-based language proficiency test; providing temporary use of non-downloadable online software for the administration of a series of examinations for teacher licensure and teacher certification; development of research-based diagnostic tools, namely, computer software, to assist schools and school districts evaluate their curriculum and instructional programs to ensure all students meet established state educational standards; conducting research and validity studies in the field of educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment; providing temporary use of non-downloadable on-line software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable on-line software for an Internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing temporary use of non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing a website featuring temporary use of non-downloadable software that enables users to take practice exams to determine readiness for high school-level proficiency and higher education and workplace readiness examinations; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of non-downloadable technology for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing a website featuring a search engine for measuring, scoring and reporting on workplace productivity, work skills and occupational proficiencies and workplace adaptation.

Abstract

Systems and methods are provided for automatic evaluation of argument critique essays written by young students in response to prompts. A transformer pre-trained for natural language processing is employed as a machine learning model, which is fine-tune with a first training dataset comprising unannotated argument critique essays written by college students, and then fine-tuned with a second training dataset comprising annotated argument critique essays written by middle school students, where each sentence in the second training dataset is annotated for the presence of valid critiques to prompts. The fine-tuned machine learning model is used to classify each sentence in an essay to be evaluated as either containing a valid critique or not.

IPC Classes  ?

• G09B 7/02 - Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by the student
• G06F 40/20 - Natural language analysis
• G06N 20/00 - Machine learning

Goods & Services

Providing test registration services for educational administration purposes; online retail store services featuring educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness Audio and video recordings, pre-recorded computer programs and downloadable computer programs from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research and standardized testing; downloadable interactive computer software to assist in curriculum development, curriculum management and the development of instructional programs for teachers, schools, school districts and educational service regions; downloadable software for use in database management for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; downloadable interactive multimedia software programs for mobile platforms for English language learning; downloadable electronic publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books in the field of preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and research of educational programs and services; downloadable software in the nature of a mobile application featuring content for testing language proficiency, for preparing for and practicing tests of language proficiency and for vocabulary enrichment; downloadable computer software for conducting tests for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; downloadable computer search engine software; downloadable computer software featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, study guides, pamphlets, posters, rosters, printed reports, printed vouchers, and printed summaries and papers featuring information pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books and booklets used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement, aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations; printed publications, namely, books, booklets, study guides, and instructional manuals in the field of test preparation, test administration and test scoring for a series of examinations for teacher licensure and teacher certification; printed tests in the field of teacher licensure and teacher certification; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and the testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness Educational testing services, namely, creating, administering, scoring and reporting a paper-based, computer-based and internet-based language proficiency test; educational testing services, namely, creating, administering and scoring tests of academic skills, abilities and learning; educational testing services, namely, administering educational tests to measure information and communication technology proficiency; educational testing services, namely, preparing, administering, scoring and reporting a series of graduate school admissions examinations; educational testing services, namely, test development, test administration and test scoring services for a series of examinations for teacher licensure and teacher certification; education services, namely, conducting seminars and providing non-downloadable webinars and workshops in the field of test preparation, teacher licensure and teacher certification; consultation in the fields of educational testing and assessment; providing educational information about testing, namely, in the field of education; arranging and conducting in-person educational forums, training workshops and seminars on graduate schools and graduate school admissions examinations; providing graduate school educational information, namely, providing information in the field of graduate school education by computer for students and educational institutions; conducting professional development workshops in the field of language instruction and learning and language proficiency test preparation; educational services, namely, providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational consulting and training services in the field of educational practices that assist teachers and administrators in evaluating collected student performance data and designing and implementing standards-based instruction based thereon to improve academic achievement; educational services, namely, developing curriculum and instruction design and implementation services in the nature of developing curriculum for educators; educational services, namely, analysis and assessment of educational curriculum, namely, providing educational assessment services of educational curriculum; providing training for educators and other individuals in the field of elementary, middle and high school education; educational consultation services in the field of elementary, middle and high school education; providing educational assessment and academic performance evaluation, namely, educational assessment of student achievement, proficiency and skill level based on established state educational standards; development of research-based diagnostic tools, namely, development and dissemination of printed educational materials of others in the field of educational assessment, to assist schools and school districts in evaluating their curriculum and instructional programs to ensure students meet established state educational standards; research in the field of education, namely, conducting research and studies with respect to educational testing and test theory; providing an online computer database featuring graduate school information and guidance for students and educational institutions; educational counseling services to assist students in planning and preparing for further education in the nature of providing graduate school guidance, providing educational assessment services; educational services, namely, providing class placement services; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing an interactive website providing educators, parents and students with educational information and educational counseling services about standardized tests and K-12 education; providing an Internet website portal featuring web links to informational sites of others regarding educational issues; publication of online non-downloadable electronic publications in the nature of booklets, leaflets and brochures regarding K-12 education and standardized testing; providing written text editing delivered via the internet; providing an online searchable database featuring educational research and validity studies in the field of educational achievement, aptitude and assessment; providing online educational assessment services; educational testing services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; educational testing services, namely, providing test score reporting services; educational assessment services, namely, providing essay scores and writing skills evaluations to students and teachers via the internet; educational assessment services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict college students' success; educational services, namely, providing internships in the field of educational research; conducting fellowship training programs in the field of educational research; education services, namely, providing online and in-person education courses and workshops for teachers and educators in the field of English language learners, language instruction and English language proficiency testing; education services, namely, providing test preparation services, namely, preparing, administering, and scoring academic for tests for English language proficiency; providing online non-downloadable pre-recorded videos related to tests of English language proficiency; providing online non-downloadable test preparation materials in the nature of e-books, study guides, teaching review books, e-books featuring practice exams, and test score reports in the field of English language proficiency testing; Online non-downloadable journals, namely, blogs and vlogs featuring non-downloadable publications in the nature of research articles, news articles and information in the field of English language learning, educational skills and educational workplace assessments, literacy, diversity, higher education, K-12 and adult education, and teaching and learning; Providing online training via instruction courses, eLearning modules in the nature of interactive lessons, interactive educational activities, virtual educational worlds, and non-downloadable videos, all in the field of improving learning, writing, reading and English language speaking skills; research and validity studies in the field of education featuring topics regarding educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment Providing temporary use of non-downloadable online software for an Internet-based language proficiency tests; providing temporary use of non-downloadable online software for the administration of a series of examinations for teacher licensure and teacher certification; development of research-based diagnostic tools, namely, computer software to schools and school districts evaluate their curriculum and instructional programs to ensure all students meet established state educational standards; providing temporary use of non-downloadable on-line software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable on-line software for an Internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing temporary use of non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing a website featuring temporary use of non-downloadable software that enables users to take practice exams to determine readiness for high school-level proficiency and higher education and workplace readiness examinations; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of non-downloadable software featuring technology for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing a website featuring a search engine for measuring, scoring and reporting on workplace productivity, work skills and occupational proficiencies and workplace adaptation

Goods & Services

Downloadable computer software for use in live digital communications, namely, live video and audio conferencing and network conferencing in the field of English language proficiency testing and test preparation; downloadable computer software for the transmission, recording, reproduction, display, organization, management, manipulation and review of messages, text, images, files, audio, video, audio-visual and multimedia content in the field of English language proficiency testing and test preparation; digital video cameras for use in the field of English language proficiency testing and test preparation; microphones for use in the field of English language proficiency testing and test preparation; recorded computer software for screening potential test takers in the field of English language proficiency testing and test preparation; downloadable computer software for screening potential test takers in the field of English language proficiency testing and test preparation. Books, informational brochures, pamphlets, circulars, instruction sheets, manuals, printed guides, research reports and newsletters, all in the field of English language proficiency testing; printed tests and printed answer sheets, all in the field of English language proficiency testing; educational books, paper teaching materials, study guides, workbooks and printed computer program manuals, all in the field of English language instruction and learning and English language proficiency test preparation; books, informational brochures, pamphlets, circulars, instruction sheets, manuals, printed guides, research reports and newsletters for teacher training coursework in the field of language instruction and learning and English language proficiency. Educational testing services, namely, creating, administering, scoring and reporting an internet-based language proficiency test; providing professional development workshops in the field of English language learners, language instruction and English language proficiency testing; providing online and in-person education courses and workshops for teachers and educators in the field of English language learners, language instruction and English language proficiency testing; providing test preparation services, namely, preparing, administering, and scoring academic tests of English language proficiency; providing online non-downloadable pre-recorded videos related to tests of English language proficiency; providing information relating to educational testing, namely, tests of English language proficiency and test administrations; providing online non-downloadable test preparation materials in the nature of e-books, study guides, teaching review materials, practice exams, and score reports in the field of English language proficiency testing; educational testing services in the nature of development and administration of an internet-based language proficiency test. Providing temporary use of non-downloadable online software for an internet-based language proficiency test; providing temporary use of non-downloadable online software for use by teachers and educators of English language learners that provides teachers and educators with access to instructional materials and classroom activities designed to personalize instruction for English language learners; providing temporary use of on-line non-downloadable applications for placement tests in the field of English language proficiency.

Abstract

Human-machine dialog is characterized by receiving data comprising a recording of an individual interacting with a dialog application simulating a conversation. Thereafter, the received data is parsed using automated speech recognition to result in text comprising a plurality of words. Features are extracted from the parsed data and then input an ensemble of different machine learning models each trained to generate a score characterizing a plurality of different dialog constructs. Thereafter, scores generated by the machine learning models for each of the dialog constructs are fused. A performance score is then generated based on the fused scores which characterizes a conversational proficiency of the individual interacting with the dialog application. Data can then be provided which includes or otherwise characterizes the generated score. Related apparatus, systems, techniques and articles are also described.

IPC Classes  ?

• G06F 40/35 - Discourse or dialogue representation
• G06F 40/205 - Parsing
• G10L 25/30 - Speech or voice analysis techniques not restricted to a single one of groups characterised by the analysis technique using neural networks

Abstract

A computer-implemented technique for characterizing lexical concreteness in narrative includes receiving data encapsulating narrative text having a plurality of words. Thereafter, the function words can be removed from the narrative text to result in only content words. A concreteness score can then be assigned to each content word by polling a database to identify matching words and to use concreteness scores associated with such matching words as specified by the database. Data can then be provided which characterizes the assigned concreteness scores. Related apparatus, systems, techniques and articles are also described.

IPC Classes  ?

• G06F 40/284 - Lexical analysis, e.g. tokenisation or collocates
• G06F 40/253 - Grammatical analysisStyle critique

Abstract

Systems and methods are provided for processing a group of essays to develop a classifier that detects nonsensical computer-generated essays. A data structure associated with a group of essays is accessed, wherein the group of essays includes nonsensical computer-generated essays and good-faith essays. Both the nonsensical computer-generated essays and the good-faith essays are assigned feature values. The distribution of feature values between the nonsensical computer-generated essays and the good-faith essays is measured. A classifier that detects whether an essay is a nonsensical computer-generated essay is developed, wherein the classifier is developed using the distribution of feature values.

IPC Classes  ?

• G09B 7/02 - Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by the student
• G06F 16/28 - Databases characterised by their database models, e.g. relational or object models
• G06F 40/253 - Grammatical analysisStyle critique
• G06N 20/20 - Ensemble learning
• G06F 40/30 - Semantic analysis
• G06N 20/10 - Machine learning using kernel methods, e.g. support vector machines [SVM]
• G06N 20/00 - Machine learning

Abstract

An electronic audio file is received that comprises spontaneous speech responsive to a prompt in a non-native language of a speaker. Thereafter, the electronic audio file is parsed into a plurality of spoken words. The spoken words are then normalized to remove stop words and disfluencies. At least one trained content scoring model is then used to determine an absence of pre-defined key points associated with the prompt in the normalized spoken words. A list of the determined absent key points can be generated. This list can then be displayed/caused to be displayed in a graphical user interface along with feedback to improve content completeness. Related apparatus, systems, techniques and articles are also described.

IPC Classes  ?

• G10L 15/06 - Creation of reference templatesTraining of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice
• G10L 15/16 - Speech classification or search using artificial neural networks
• G10L 15/18 - Speech classification or search using natural language modelling
• G06F 3/048 - Interaction techniques based on graphical user interfaces [GUI]
• G10L 17/12 - Score normalisation
• G06N 3/08 - Learning methods
• G06N 20/10 - Machine learning using kernel methods, e.g. support vector machines [SVM]
• G10L 15/187 - Phonemic context, e.g. pronunciation rules, phonotactical constraints or phoneme n-grams

Goods & Services

Online downloadable electronic publications in the nature of test registration forms, practice tests, study guides, workbooks, books, test forms and answer sheets and instruction manuals provided to students and teachers in the field of education Printed publications in the nature of test registration forms, practice tests, study guides, workbooks, books, test forms and answer sheets and instruction manuals provided to students and teachers in the field of education Standardized testing services, namely, preparing, administering and scoring of standardized tests; information in the field of educational training and educational testing for teacher certification requirements Information services in the field of state teacher certification requirements; providing temporary use of non-downloadable online software for administering computer-delivered teacher certification assessments

Goods & Services

Online downloadable electronic publications in the nature of test registration forms, practice tests, study guides, workbooks, books, test forms and answer sheets and instruction manuals provided to students and teachers in the field of education Printed publications in the nature of test registration forms, practice tests, study guides, workbooks, books, test forms and answer sheets and instruction manuals provided to students and teachers in the field of education Standardized testing services, namely, preparing, administering and scoring of standardized tests; information in the field of educational training and educational testing for teacher certification requirements Information services in the field of state teacher certification requirements; providing temporary use of non-downloadable online software for administering computer-delivered teacher certification assessments

Abstract

Systems and methods are disclosed for automatically scoring a constructed response using a neural network. In embodiments, a constructed response received by a processing system may be processed to divide the constructed response into multiple series of word tokens, wherein each word token includes a sequence of characters. The constructed response may be further processed to correct one or more spelling errors. The word tokens may be encoded to generate representation vectors for the constructed response. A set of nonlinear operations may be applied to the plurality of representation vectors in a neural network to generate a single vector output. A set of predetermined network weights may be applied to the vector output of the neural network to generate a scalar output for scoring the constructed response.

IPC Classes  ?

• G06N 3/08 - Learning methods
• G06F 40/284 - Lexical analysis, e.g. tokenisation or collocates
• G06F 40/232 - Orthographic correction, e.g. spell checking or vowelisation

Abstract

A method comprising accessing a first data structure that is associated with a first product prepared by a student and that includes first process data associated with a process performed by the student in generating the first product, analyzing the first data structure to generate a first characterization score based on the first product and the first process data, accessing a second data structure that is associated with a second product prepared by the student and that includes second process data associated with a process performed by the student in generating the second product, analyzing the second data structure to generate a second characterization score based on the second product and the second process data, and calculating a skill level change metric based on the first characterization score and the second characterization score indicating a change in ability level of the student over a course of the scenario-based assessment.

IPC Classes  ?

• G09B 7/02 - Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by the student
• G06F 16/2457 - Query processing with adaptation to user needs
• G09B 19/00 - Teaching not covered by other main groups of this subclass

Abstract

Data is received that encapsulates a document of text. The text is then segmented into a plurality of semantically coherent units using a coherence-aware text segmentation (CATS) machine learning model. Data is then provided that characterizes the segmenting. Related apparatus, systems, techniques and articles are also described.

IPC Classes  ?

• G06F 40/289 - Phrasal analysis, e.g. finite state techniques or chunking
• G06F 40/30 - Semantic analysis
• G06N 3/096 - Transfer learning
• G06N 20/00 - Machine learning
• G06F 40/284 - Lexical analysis, e.g. tokenisation or collocates
• G06F 40/253 - Grammatical analysisStyle critique
• G06N 3/08 - Learning methods

Abstract

Reading comprehension of a user can be assessed by presenting, in a graphical user interface, sequential reading text comprising a plurality of passages. The graphical user interface can alternate between (i) automatically advancing through passages of the reading text and (ii) manually advancing through passages of the reading text within the graphical user interface which is in response to user-generated input received via the graphical user interface. An audio narration is provided during the automatic advancing of the reading text. An audio file is recorded during the manual advancing of the reading text which is used to automatically determine an estimated level of reading comprehension of the user. Data characterizing the determined level of reading comprehension of the user can then be provided (e.g., displayed, loaded into memory, stored on a hard drive, transmitted to a remote computing system, etc.). Related apparatus, systems, techniques and articles are also described.

IPC Classes  ?

• G09B 17/00 - Teaching reading
• G06F 15/02 - Digital computers in generalData processing equipment in general manually operated with input through keyboard and computation using a built-in program, e.g. pocket calculators
• G06N 3/08 - Learning methods
• G06F 3/0483 - Interaction with page-structured environments, e.g. book metaphor

Goods & Services

Computer programs recorded on compact disks and CD-ROMs, for use in the field of language proficiency testing and test preparation; downloadable electronic publications, namely, ebooks and score reports for preparing for and practicing standardized tests of language proficiency; downloadable software in the nature of a mobile application for use in preparing for and practicing standardized tests of language proficiency

Abstract

Biometric keystroke measure data derived from a computer-implemented long form examination taken by an examinee is received. Features are the extracted from the biometric keystroke measure data for the examinee. A similarity value is then determined, using one or more of a direct distance approach or a machine learning approach, for the extracted features relative to features extracted from biometric keystroke measure data derived from each of a plurality of other examinees while taking the long form examination. At least one of the determined similarity values is then identified having a value above a pre-defined threshold. The pre-defined threshold indicates a likelihood of the examinee being the same as one of the other examinees. Data can then be provided that characterizes the identification. Related apparatus, systems, techniques and articles are also described.

IPC Classes  ?

• G06F 21/00 - Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
• G06F 21/51 - Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems at application loading time, e.g. accepting, rejecting, starting or inhibiting executable software based on integrity or source reliability
• G06N 20/20 - Ensemble learning
• G06F 11/30 - Monitoring
• G06F 11/34 - Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation
• G06N 5/04 - Inference or reasoning models

Goods & Services

(1) Computer programs recorded on compact disks and CD-ROMS for use in the field of language proficiency testing and test preparation; downloadable electronic publications, namely, e-books, booklets and score reports for preparing for and practicing standardized tests of language proficiency. (1) Educational services, namely, creating, administering, scoring and reporting an internet-based language proficiency test; professional development workshops in the field of language instruction and learning and language proficiency test preparation. (2) Providing temporary use of non-downloadable on-line software for an internet-based language proficiency test; software development, namely, development of an internet-based language proficiency test.

Abstract

Systems and methods are provided for the design and implementation of experiments that facilitate the investigation of process data. The experiments involve recording the completion of a task by participants and then playing back the video of task completion to automatically probe participants about their affective, behavioral, and cognitive experiences. As a result of this system, information about affective, behavioral, and cognitive processes can be more easily investigated by researchers without computer programming knowledge. Corresponding apparatuses, systems, and methods are also discussed.

IPC Classes  ?

• G09B 19/00 - Teaching not covered by other main groups of this subclass
• G09B 7/02 - Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by the student
• G09B 7/06 - Electrically-operated teaching apparatus or devices working with questions and answers of the multiple-choice answer type, i.e. where a given question is provided with a series of answers and a choice has to be made from the answers

Abstract

Systems and methods for computer-implemented evaluation of a performance are provided. In a first aspect, a computer-implemented method of evaluating an interaction generates a first temporal record of first behavior features exhibited by a first entity during an interaction between a first entity and a second entity. A second temporal record is generated including second behavior features exhibited by a second entity during an interaction with a first entity. A determination is made that a first feature of a first temporal record is associated with a second feature of a second temporal record. The length of time that passes between the first feature and second feature is evaluated, and a determination is made that the length of time satisfies a temporal condition. A co-occurrence record associated with a first feature and a second feature is generated and included in a co-occurrence record data-structure.

IPC Classes  ?

• G06N 3/00 - Computing arrangements based on biological models
• G06N 20/00 - Machine learning
• G06F 16/22 - IndexingData structures thereforStorage structures

Goods & Services

(1) Audio and video recordings, pre-recorded computer programs and computer programs downloadable from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research and standardized testing; interactive computer software to assist in curriculum development, curriculum management and the development of instructional programs for teachers, schools, school districts and educational service regions; database management software for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; interactive multimedia software programs for mobile platforms for English language learning; downloadable publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books for use in preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and in researching educational programs and services; downloadable software in the nature of a mobile application featuring content for testing language proficiency, for preparing for and practicing tests of language proficiency and for vocabulary enrichment; downloadable computer based tests for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; computer search engine software; downloadable computer software featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application for use in preparation for educational, occupational proficiency, workplace productivity and work skills testing and assessments and in researching educational programs and services and job skills and careers; downloadable software in the nature of a mobile application for use in preparation for testing and assessments related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable electronic publications, namely, e-books, study guides, review materials, practice exams, score reports, and downloadable audio and video recordings featuring test preparation materials for preparing for and practicing tests of English language proficiency; downloadable electronic publications, namely, e-books, study guides, review materials, practice exams, score reports, and downloadable audio and video recordings for teacher training coursework in the field of language instruction and learning and English language proficiency; downloadable software for use by teachers and educators of English language learners that provides teachers and educators with access to instructional materials and classroom activities designed to personalize instruction for English language learners (2) Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, guides, pamphlets, posters, rosters, printed reports, vouchers, summaries and papers pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books and booklets used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement, aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations; printed publications, namely, books, booklets, study guides, and instructional manuals in the field of test preparation, test administration and test scoring for a series of examinations for teacher licensure and teacher certification; printed tests in the field of teacher licensure and teacher certification; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and the testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; printed publications, namely, books, informational brochures, pamphlets, circulars, instruction sheets, manuals, printed guides, research reports and newsletters, all in the field of English language proficiency testing; printed tests and printed answer sheets, all in the field of English language proficiency testing; educational books, paper teaching materials, study guides, workbooks and computer program manuals, all in the field of English language instruction and learning and English language proficiency test preparation; books, informational brochures, pamphlets, circulars, instruction sheets, manuals, printed guides, research reports and newsletters for teacher training coursework in the field of language instruction and learning and English language proficiency (1) Providing test registration services; online retail store services featuring educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness (2) Creating, administering, scoring and reporting a paper-based, computer-based and internet-based language proficiency test; creating, administering and scoring tests of academic skills, abilities and learning; administering educational tests to measure information and communication technology proficiency; preparing, administering, scoring and reporting a series of graduate school admissions examinations; test development, test administration and test scoring services for a series of examinations for teacher licensure and teacher certification; conducting seminars, webinars and workshops in the field of test preparation, teacher licensure and teacher certification; consultation in the fields of educational testing and assessment; providing educational information about testing, namely, in the field of education; organizing in-person educational forums and conducting training workshops and seminars on graduate schools and graduate school admissions examinations; providing graduate school educational information by computer for students and educational institutions; conducting professional development workshops in the field of language instruction and learning and language proficiency test preparation; providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational consulting and training services in the field of educational practices that assist teachers and administrators in evaluating collected student performance data and designing and implementing standards-based instruction based thereon to improve academic achievement; educational services, namely, curriculum and instruction design and implementation services; analysis and assessment of educational curriculum; training and educational consultation services in the field of elementary, middle and high school education; assessment and evaluation of student achievement, proficiency and skill level based on established state educational standards; development of research-based diagnostic tools, namely, printed materials, to assist schools and school districts in evaluating their curriculum and instructional programs to ensure students meet established state educational standards; conducting research and studies with respect to educational testing and test theory; providing an online database featuring graduate school information and guidance for students and educational institutions; providing graduate school guidance, assessment and placement services; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing an interactive website providing educators, parents and students with educational information and counseling about standardized tests and K-12 education; providing weblinks to informational sites of others regarding educational issues; publication of booklets, leaflets and brochures regarding K-12 education and standardized testing; providing written text editing delivered via the internet; providing an online searchable database featuring educational research and validity studies in the field of educational achievement, aptitude and assessment; providing online educational assessments; educational services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing test score reporting services; educational services, namely, providing essay scores and writing skills evaluations to students and teachers via the internet; educational services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict college students' success; educational services, namely, providing internships and fellowships in the field of educational research; providing online and in-person courses and workshops for teachers and educators in the field of English language learners, language instruction and English language proficiency testing; providing test preparation services for tests of English language proficiency; providing online non-downloadable pre-recorded videos related to tests of English language proficiency; providing online non-downloadable test preparation materials in the nature of e-books, study guides, review materials, practice exams, score reports, and downloadable audio and video for preparing for and practicing tests of English language proficiency; educational services, namely, providing online and mobile application based placement tests in the field of English language proficiency; online journals, namely, blogs and vlogs featuring non-downloadable publications in the nature of research articles, news articles and information in the field of English language learning, educational skills and workplace assessments, literacy, diversity, higher education, K-12 and adult education, and teaching and learning; Providing online training via instruction, eLearning modules in the nature of interactive lessons, interactive educational activities, virtual educational worlds, and non-downloadable videos, all in the field of improving learning, writing, reading and English language speaking skills (3) Providing temporary use of non-downloadable online software for an internet-based language proficiency test; providing temporary use of non-downloadable online software for the administration of a series of examinations for teacher licensure and teacher certification; development of research-based diagnostic tools, namely, computer software, to assist schools and school districts in evaluating their curriculum and instructional programs to ensure students meet established state educational standards; conducting research and validity studies in the field of educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment; providing temporary use of non-downloadable online software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable online software for an internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing temporary use of non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing a website featuring temporary use of non-downloadable software that enables users to take practice exams to determine readiness for high school-level proficiency and higher education and workplace readiness examinations; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of non-downloadable technology for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing a website featuring a search engine for measuring, scoring and reporting on workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing temporary use of non-downloadable online software for use by teachers and educators of English language learners that provides teachers and educators with access to instructional materials and classroom activities designed to personalize instruction for English language learners

Goods & Services

(1) Audio and video recordings, pre-recorded computer programs and computer programs downloadable from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research and standardized testing; interactive computer software to assist in curriculum development, curriculum management and the development of instructional programs for teachers, schools, school districts and educational service regions; database management software for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; interactive multimedia software programs for mobile platforms for English language learning; downloadable publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books for use in preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and in researching educational programs and services; downloadable software in the nature of a mobile application featuring content for testing language proficiency, for preparing for and practicing tests of language proficiency and for vocabulary enrichment; downloadable computer based tests for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; computer search engine software; downloadable computer software featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application for use in preparation for educational, occupational proficiency, workplace productivity and work skills testing and assessments and in researching educational programs and services and job skills and careers; downloadable software in the nature of a mobile application for use in preparation for testing and assessments related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable electronic publications, namely, e-books, study guides, review materials, practice exams, score reports, and downloadable audio and video recordings featuring test preparation materials for preparing for and practicing tests of English language proficiency; downloadable electronic publications, namely, e-books, study guides, review materials, practice exams, score reports, and downloadable audio and video recordings for teacher training coursework in the field of language instruction and learning and English language proficiency; downloadable software for use by teachers and educators of English language learners that provides teachers and educators with access to instructional materials and classroom activities designed to personalize instruction for English language learners (2) Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, guides, pamphlets, posters, rosters, printed reports, vouchers, summaries and papers pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books and booklets used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement, aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations; printed publications, namely, books, booklets, study guides, and instructional manuals in the field of test preparation, test administration and test scoring for a series of examinations for teacher licensure and teacher certification; printed tests in the field of teacher licensure and teacher certification; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and the testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; printed publications, namely, books, informational brochures, pamphlets, circulars, instruction sheets, manuals, printed guides, research reports and newsletters, all in the field of English language proficiency testing; printed tests and printed answer sheets, all in the field of English language proficiency testing; educational books, paper teaching materials, study guides, workbooks and computer program manuals, all in the field of English language instruction and learning and English language proficiency test preparation; books, informational brochures, pamphlets, circulars, instruction sheets, manuals, printed guides, research reports and newsletters for teacher training coursework in the field of language instruction and learning and English language proficiency (1) Providing test registration services; online retail store services featuring educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness (2) Creating, administering, scoring and reporting a paper-based, computer-based and internet-based language proficiency test; creating, administering and scoring tests of academic skills, abilities and learning; administering educational tests to measure information and communication technology proficiency; preparing, administering, scoring and reporting a series of graduate school admissions examinations; test development, test administration and test scoring services for a series of examinations for teacher licensure and teacher certification; conducting seminars, webinars and workshops in the field of test preparation, teacher licensure and teacher certification; consultation in the fields of educational testing and assessment; providing educational information about testing, namely, in the field of education; organizing in-person educational forums and conducting training workshops and seminars on graduate schools and graduate school admissions examinations; providing graduate school educational information by computer for students and educational institutions; conducting professional development workshops in the field of language instruction and learning and language proficiency test preparation; providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational consulting and training services in the field of educational practices that assist teachers and administrators in evaluating collected student performance data and designing and implementing standards-based instruction based thereon to improve academic achievement; educational services, namely, curriculum and instruction design and implementation services; analysis and assessment of educational curriculum; training and educational consultation services in the field of elementary, middle and high school education; assessment and evaluation of student achievement, proficiency and skill level based on established state educational standards; development of research-based diagnostic tools, namely, printed materials, to assist schools and school districts in evaluating their curriculum and instructional programs to ensure students meet established state educational standards; conducting research and studies with respect to educational testing and test theory; providing an online database featuring graduate school information and guidance for students and educational institutions; providing graduate school guidance, assessment and placement services; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing an interactive website providing educators, parents and students with educational information and counseling about standardized tests and K-12 education; providing weblinks to informational sites of others regarding educational issues; publication of booklets, leaflets and brochures regarding K-12 education and standardized testing; providing written text editing delivered via the internet; providing an online searchable database featuring educational research and validity studies in the field of educational achievement, aptitude and assessment; providing online educational assessments; educational services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing test score reporting services; educational services, namely, providing essay scores and writing skills evaluations to students and teachers via the internet; educational services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict college students' success; educational services, namely, providing internships and fellowships in the field of educational research; providing online and in-person courses and workshops for teachers and educators in the field of English language learners, language instruction and English language proficiency testing; providing test preparation services for tests of English language proficiency; providing online non-downloadable pre-recorded videos related to tests of English language proficiency; providing online non-downloadable test preparation materials in the nature of e-books, study guides, review materials, practice exams, score reports, and downloadable audio and video for preparing for and practicing tests of English language proficiency; educational services, namely, providing online and mobile application based placement tests in the field of English language proficiency; online journals, namely, blogs and vlogs featuring non-downloadable publications in the nature of research articles, news articles and information in the field of English language learning, educational skills and workplace assessments, literacy, diversity, higher education, K-12 and adult education, and teaching and learning; Providing online training via instruction, eLearning modules in the nature of interactive lessons, interactive educational activities, virtual educational worlds, and non-downloadable videos, all in the field of improving learning, writing, reading and English language speaking skills (3) Providing temporary use of non-downloadable online software for an internet-based language proficiency test; providing temporary use of non-downloadable online software for the administration of a series of examinations for teacher licensure and teacher certification; development of research-based diagnostic tools, namely, computer software, to assist schools and school districts in evaluating their curriculum and instructional programs to ensure students meet established state educational standards; conducting research and validity studies in the field of educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment; providing temporary use of non-downloadable online software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable online software for an internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing temporary use of non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing a website featuring temporary use of non-downloadable software that enables users to take practice exams to determine readiness for high school-level proficiency and higher education and workplace readiness examinations; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of non-downloadable technology for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing a website featuring a search engine for measuring, scoring and reporting on workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing temporary use of non-downloadable online software for use by teachers and educators of English language learners that provides teachers and educators with access to instructional materials and classroom activities designed to personalize instruction for English language learners

Abstract

Systems and methods are provided for automatically scoring a constructed response. The constructed response is processed to generate a plurality of numerical vectors that is representative of the constructed response. A model is applied to the plurality of numerical vectors. The model includes an input layer configured to receive the plurality of numerical vectors, the input layer being connected to a following layer of the model via a first plurality of connections. Each of the connections has a first weight. An intermediate layer of nodes is configured to receive inputs from an immediately-preceding layer of the model via a second plurality of connections, each of the connections having a second weight. An output layer is connected to the intermediate layer via a third plurality of connections, each of the connections having a third weight. The output layer is configured to generate a score for the constructed response.

IPC Classes  ?

• G06N 3/04 - Architecture, e.g. interconnection topology
• G06N 3/08 - Learning methods

Abstract

Systems and methods are provided for processing a drawing in a modeling prototype. A data structure associated with a visual model is accessed. The visual model is analyzed to extract construct-relevant features, where the construct-relevant features are extracted using a drawing object by identifying visual attributes of the visual model and populating a data structure for each object drawn. The visual model is analyzed to generate a statistical model, where the statistical model is generated using a multidimensional scoring rubric by targeting different constructs which compositely estimate learning progression levels, wherein the statistical model is based on features that are principally aligned with one or more of the constructs. An automated scoring is determined based on the construct-relevant features and the statistical model, where the automated scoring is stored in a computer readable medium. and is outputted for display, transmitted across a computer network, or printed.

IPC Classes  ?

• G06K 9/62 - Methods or arrangements for recognition using electronic means
• G06N 7/00 - Computing arrangements based on specific mathematical models
• G06F 3/0354 - Pointing devices displaced or positioned by the userAccessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
• G06N 3/08 - Learning methods

Abstract

Data is received that encapsulates a spoken response to a prompt text comprising a string of words. Thereafter, the received data is transcribed into a string of words. The string of words is then compared with a prompt so that a similarity grid representation of the comparison can be generated that characterizes a level of similarity between the string of words in the spoken response and the string of words in the prompt text. The grid representation is then scored using at least one machine learning model. The score indicates a likelihood of the spoken response having been off-topic. Data providing the encapsulated score can then be provided. Related apparatus, systems, techniques and articles are also described.

IPC Classes  ?

• G10L 15/26 - Speech to text systems
• G10L 15/16 - Speech classification or search using artificial neural networks
• G06N 3/08 - Learning methods

Goods & Services

Providing access to employers to find potential employees, specifically, providing multiple-user access to data on the Internet in the field of employment counseling; providing an online searchable database featuring skill testing for potential employment opportunities; providing assessments to identify career interests to determine employment skills and job suitability providing training opportunities to strengthen career skills Platform as a service (PAAS) featuring an online computer software platform for job and career seekers and employers to identify career interests

Abstract

Data is received that encapsulates a spoken response to a test question. Thereafter, the received data is transcribed into a string of words. The string of words is then compared with at least one source string so that a similarity grid representation of the comparison can be generated that characterizes a level of similarity between the string of words and the at least one source string. The grid representation is then scored using at least one machine learning model. The score indicates a likelihood of the spoken response having been plagiarized. Data providing the encapsulated score can then be provided. Related apparatus, systems, techniques and articles are also described.

IPC Classes  ?

• G10L 15/26 - Speech to text systems
• G10L 15/197 - Probabilistic grammars, e.g. word n-grams
• G10L 25/51 - Speech or voice analysis techniques not restricted to a single one of groups specially adapted for particular use for comparison or discrimination
• G10L 15/16 - Speech classification or search using artificial neural networks

Abstract

Computer-implemented systems and methods are described herein for detecting unusually frequent exactly matching and nearly matching test responses. A plurality of test responses for each of a plurality of test takers is received. Evidence of a circulated key from the plurality of test responses is identified by detecting two or more test takers with exactly matching test responses for a plurality of questions. The strength of the evidence of the circulated key is analyzed by determining the probability that the two or more test takers would produce exactly matching test responses, wherein the strength of the evidence is inversely related to the probability. Test takers with nearly matching test responses to the circulated key are then identified. All test takers with exactly matching and nearly matching test responses are tagged for further investigation.

IPC Classes  ?

• G09B 7/00 - Electrically-operated teaching apparatus or devices working with questions and answers
• G06F 11/30 - Monitoring
• G06F 11/34 - Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation

Abstract

Systems and methods for identifying a person's native language and/or non-native language based on code-switched text and/or speech, are presented. The systems may be trained using various methods. For example, a language identification system may be trained using one or more code-switched corpora. Text and/or speech features may be extracted from the corpora and used, in combination with a per-word language identify of the text and/or speech, to train at least one machine learner. Code-switched text and/or speech may be received and processed by extracting text and/or speech features. These features may be fed into the at least one machine learner to identify the person's native language.

IPC Classes  ?

• G10L 15/05 - Word boundary detection
• G10L 15/00 - Speech recognition
• G10L 25/24 - Speech or voice analysis techniques not restricted to a single one of groups characterised by the type of extracted parameters the extracted parameters being the cepstrum
• G10L 15/22 - Procedures used during a speech recognition process, e.g. man-machine dialog
• G10L 15/06 - Creation of reference templatesTraining of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice
• G10L 15/16 - Speech classification or search using artificial neural networks

Goods & Services

(1) Providing temporary use of non-downloadable computer software for use in measuring, scoring and evaluating English language oral communication proficiencies and for providing feedback on the assessment of such proficiencies

Abstract

Systems and methods are provided for conducting a simulated conversation with a language learner include determining a first dialog state of the simulated conversation. First audio data corresponding to simulated speech based on the dialog state is transmitted. Second audio data corresponding to a variable length utterance spoken in response to the simulated speech is received. A fixed dimension vector is generated based on the variable length utterance. A semantic label is predicted for the variable-length utterance based on the fixed dimension vector. A second dialog state of the simulated conversation is determined based on the semantic label, and third audio data corresponding to simulated speech is transmitted based on the second dialog state.

IPC Classes  ?

• G10L 15/16 - Speech classification or search using artificial neural networks
• G10L 15/18 - Speech classification or search using natural language modelling
• G10L 15/22 - Procedures used during a speech recognition process, e.g. man-machine dialog
• G10L 15/24 - Speech recognition using non-acoustical features
• G10L 25/24 - Speech or voice analysis techniques not restricted to a single one of groups characterised by the type of extracted parameters the extracted parameters being the cepstrum

Abstract

Systems and methods for defining and using an optimal burst boundary threshold to assess the reliability of a manual/automatic writing score are presented. Keystroke data, including inter-key interval data, such as inter-word interval data, may be gathered from writings. Clustering analyses may be performed on the inter-key interval data to determine an optimal number of bursts for the writings. An optimal burst boundary may be determined from the optimal number of bursts. Other burst-related measures and statistics, including the average and maximum burst lengths, may be determined from the writings based on the optimal burst boundary threshold. A score may be received for each of the writings. A validation indication metric may be generated for each of the writings based on the received score and the optimal burst boundary threshold. The resulting measures and statistics may be used or applied in different ways and provide personalized feedback as learning analytics.

IPC Classes  ?

• G09B 19/00 - Teaching not covered by other main groups of this subclass
• G09B 7/02 - Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by the student

Abstract

Methods and systems for scoring an argument critique written essay, including identifying a discourse segment of the argument critique written essay, determining a position of each sentence in the discourse segment, classifying sentences into discourse units, evaluating an argumentative content of each sentence, and assigning an argumentative score to the essay based on the argumentative content of each sentence in the discourse segment of that essay. Methods and systems for training the scoring method are also disclosed. Corresponding apparatuses, systems, and methods are also disclosed.

IPC Classes  ?

• G09B 7/02 - Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by the student
• G06F 40/35 - Discourse or dialogue representation
• G06F 40/253 - Grammatical analysisStyle critique
• G06F 40/289 - Phrasal analysis, e.g. finite state techniques or chunking

Abstract

Systems and methods are provided for acquiring physical-world data indicative of interactions of a subject with an avatar for evaluation. An interactive avatar is provided for interaction with the subject. Speech from the subject to the avatar is captured, and automatic speech recognition is performed to determine content of the subject speech. Motion data from the subject interacting with the avatar is captured. A next action of the interactive avatar is determined based on the content of the subject speech or the motion data. The next action of the avatar is implemented, and a score for the subject is determined based on the content of the subject speech and the motion data.

IPC Classes  ?

• G09B 9/00 - Simulators for teaching or training purposes
• G09B 5/06 - Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
• G10L 15/06 - Creation of reference templatesTraining of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice
• G06T 7/20 - Analysis of motion
• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• G09B 7/02 - Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by the student

Abstract

Systems and methods are provided for automatic detection of plagiarized spoken responses during standardized testing of language proficiency. A first spoken response to a speaking task that elicits spontaneous speech and a second spoken response to a source-based speaking task that is assumed to be non-plagiarized are digitally recorded. A first and second sets of speaking proficiency features are calculated for the first and the second spoken response, respectively. The first spoken response is classifying as plagiarized or non-plagiarized based on the comparison between the first and the second set of speaking proficiency features. Corresponding apparatuses, systems, and methods are also disclosed.

IPC Classes  ?

• G10L 25/51 - Speech or voice analysis techniques not restricted to a single one of groups specially adapted for particular use for comparison or discrimination
• G10L 15/18 - Speech classification or search using natural language modelling
• G10L 15/22 - Procedures used during a speech recognition process, e.g. man-machine dialog
• G10L 15/19 - Grammatical context, e.g. disambiguation of recognition hypotheses based on word sequence rules
• G10L 15/00 - Speech recognition

Goods & Services

Downloadable computer software for use in live digital communications, namely, live video and audio conferencing and network conferencing in the field of English language proficiency testing and test preparation; downloadable computer software for the transmission, recording, reproduction, display, organization, management, manipulation and review of messages, text, images, files, audio, video, audio-visual and multimedia content in the field of English language proficiency testing and test preparation; digital video cameras for use in the field of English language proficiency testing and test preparation; microphones for use in the field of English language proficiency testing and test preparation; recorded computer software for screening potential test takers in the field of English language proficiency testing and test preparation; downloadable computer software for screening potential test takers in the field of English language proficiency testing and test preparation Providing telephone conferencing services in the field of English language proficiency testing and test preparation; telepresence conferencing services in the field of English language proficiency testing and test preparation; audio teleconferencing in the field of English language proficiency testing and test preparation; voice over internet protocol (VOIP) services in the field of English language proficiency testing and test preparation; audio and video broadcasting services over the Internet in the field of English language proficiency testing and test preparation; text messaging services in the field of English language proficiency testing and test preparation; videotext services in the field of English language proficiency testing and test preparation; video conferencing services in the field of English language proficiency testing and test preparation; web conferencing services; providing voice chat services in the field of English language proficiency testing and test preparation; streaming of audio and video material over the Internet in the field of English language proficiency testing and test preparation; electronic delivery of images, text and data via a global computer network in the field of English language proficiency and test preparation Providing temporary use of on-line non-downloadable software for enabling and managing multiple modes of communication over the Internet via voice over internet protocol (VOIP), video conferencing or audio conferencing in the field of English language proficiency testing and test preparation; providing a website featuring technology that enables users to transfer files to and from a file transfer protocol server in the field of English language proficiency testing and test preparation; technical advice and information in relation to on-line non-downloadable software for enabling and managing multiple modes of communication in the field of English language proficiency testing and test preparation; hosting of digital content on the Internet in the field of English language proficiency testing and test preparation; software as a service (SAAS) featuring software for live digital communications, namely, live video and audio conferencing and network conferencing in the field of English language proficiency testing and test preparation

Abstract

Systems and methods are provided for automatically scoring a response and statistically revaluating whether it can be considered as aberrant. In one embodiment, a constructed response is evaluated via a pre-screening stage and a post-hoc screening stage. The pre-screening stage attempts to determine whether the constructed response is aberrant based on a variety of aberration metrics and criteria. If the constructed response is deemed not to be aberrant, then the post-hoc screening stage attempts to predict a discrepancy between what score an automated scoring system would assigned and what score a human rater would assign to the response. If the discrepancy is sufficiently low, then the constructed response may be scored by an automated scoring engine. On the other hand, if the constructed response failed to pass either of the two stages, then a flag may be raised to indicate that additional human review may be needed.

IPC Classes  ?

• G09B 7/02 - Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by the student
• G06F 40/20 - Natural language analysis

Abstract

Computer-implemented systems and methods are described herein for automatically generating questions from text. Text including one or more sentences is received. A sentence, comprising a predicate and one or more arguments associated with the predicate, is parsed from the text. Semantic role labels are assigned to the one or more arguments associated with the predicate. One or more questions are automatically generated relating to the predicate based on the assigned semantic role labels. Each answer to the generated questions is one of the one or more arguments associated with the predicate.

IPC Classes  ?

• G06F 40/30 - Semantic analysis
• G06F 40/211 - Syntactic parsing, e.g. based on context-free grammar [CFG] or unification grammars
• G06F 40/253 - Grammatical analysisStyle critique
• G06F 40/289 - Phrasal analysis, e.g. finite state techniques or chunking

Abstract

Systems and methods of improving reading fluency by presenting a virtual reading partner that takes turns reading aloud with a reader, are presented. First audio data comprising speech corresponding to the reader reading aloud from a first portion of a written transcript is received. The first audio data is processed to identify spoken words from the speech. The reader's speaking of the words in the first portion of the written transcript are compared to correct speaking of words in the first portion of the written transcript. A reading fluency of the reader is assessed. Second audio data comprising a pre-recorded narration of a second portion of the written transcript or automatically generated text to speech of the second portion is generated. The virtual reading partner is presented to the reader and takes turns reading aloud with the reader until the end of the written transcript has been reached.

IPC Classes  ?

• G09B 17/00 - Teaching reading
• G09B 17/04 - Teaching reading for increasing the rate of readingReading rate control
• G09B 17/02 - Line indicators or other guides or masks
• G10L 13/00 - Speech synthesisText to speech systems

Abstract

Systems and methods are provided for providing feedback on a user's writing behavior in generating a constructed response. An electronic process log for the constructed response is received. The electronic process log is processed to generate a vector having a predetermined number of elements. The vector comprises information related to the user's actions in generating the constructed response and includes (i) data indicating types of actions performed by the user in generating the constructed response, (ii) time points associated with the actions, and (iii) locations associated with the actions, each location indicating whether an associated action occurred within a word, between words, within a phrase, between phrases, within a sentence, between sentences, within a paragraph, or between paragraph. The vector is compared to one or more vectors associated with other constructed responses, and feedback is generated based on the comparison.

IPC Classes  ?

• G09B 7/02 - Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by the student
• G09B 5/02 - Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
• G09B 5/14 - Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
• A61B 5/16 - Devices for psychotechnicsTesting reaction times
• G09B 19/02 - CountingCalculating
• G09B 7/08 - Electrically-operated teaching apparatus or devices working with questions and answers of the multiple-choice answer type, i.e. where a given question is provided with a series of answers and a choice has to be made from the answers characterised by modifying the teaching programme in response to a wrong answer, e.g. repeating the question, supplying further information
• G09B 7/00 - Electrically-operated teaching apparatus or devices working with questions and answers

Goods & Services

Educational counseling services to assist students in planning and preparing for higher education; providing a website that features information about higher education resources; online journals, namely, blogs featuring information in the field of higher education; providing an online, user-generated searchable database for assisting students in finding and applying for higher education programs

Abstract

A system for end-to-end automated scoring is disclosed. The system includes a word embedding layer for converting a plurality of ASR outputs into input tensors; a neural network lexical model encoder receiving the input tensors; a neural network acoustic model encoder implementing AM posterior probability, word duration, mean value of pitch and mean value of intensity based on a plurality of cues; and a linear regression module, for receiving concatenated encoded features from the neural network lexical model encoder and the neural network acoustic model encoder.

IPC Classes  ?

• G10L 25/30 - Speech or voice analysis techniques not restricted to a single one of groups characterised by the analysis technique using neural networks
• G10L 15/16 - Speech classification or search using artificial neural networks
• G06F 17/18 - Complex mathematical operations for evaluating statistical data
• G06N 3/04 - Architecture, e.g. interconnection topology
• G06F 40/284 - Lexical analysis, e.g. tokenisation or collocates
• G10L 25/60 - Speech or voice analysis techniques not restricted to a single one of groups specially adapted for particular use for comparison or discrimination for measuring the quality of voice signals

Abstract

Systems and methods are provided for processing a response to essay prompts that request a narrative response. A data structure associated with a narrative essay is accessed. The essay is analyzed to generate an organization subscore, where the organization subscore is generated using a graph metric by identifying content words in each sentence of the essay and populating a data structure with links between related content words in neighboring sentences, wherein the organization subscore is determined based on the links. The essay is analyzed to generate a development subscore, where the development subscore is generated using a transition metric by accessing a transition cue data store and identifying transition words in the essay, wherein the development subscore is based on a number of words in the essay that match words in the transition cue data store. A narrative quality metric is determined based on the organization subscore and the development subscore.

IPC Classes  ?

• G06F 40/279 - Recognition of textual entities
• G06F 16/34 - BrowsingVisualisation therefor
• G06F 16/31 - IndexingData structures thereforStorage structures
• G06F 40/30 - Semantic analysis

Abstract

Computer-implemented systems and methods are provided for automatically generating recitation items. For example, a computer performing the recitation item generation can receive one or more text sets that each includes one or more texts. The computer can determine a value for each text set using one or more metrics, such as a vocabulary difficulty metric, a syntactic complexity metric, a phoneme distribution metric, a phonetic difficulty metric, and a prosody distribution metric. Then the computer can select a final text set based on the value associated with each text set. The selected final text set can be used as the recitation items for a speaking assessment test.

IPC Classes  ?

• G09B 19/04 - Speaking
• G10L 13/08 - Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• G06F 40/211 - Syntactic parsing, e.g. based on context-free grammar [CFG] or unification grammars

Goods & Services

COMPUTER PROGRAMS RECORDED ON COMPACT DISKS AND CD-ROMS FOR USE IN THE FIELD OF LANGUAGE PROFICIENCY TESTING AND TEST PREPARATION; DOWNLOADABLE ELECTRONIC PUBLICATIONS, namely, E-BOOKS, BOOKLETS AND SCORE REPORTS FOR PREPARING FOR AND PRACTICING STANDARDIZED TESTS OF LANGUAGE PROFICIENCY BOOKS, INFORMATIONAL BROCHURES, PAMPHLETS, CIRCULARS, INSTRUCTION SHEETS, MANUALS, PRINTED GUIDES, RESEARCH REPORTS AND NEWSLETTERS, ALL IN THE FIELD OF LANGUAGE PROFICIENCY TESTING AND EVALUATION; PRINTED TESTS AND PRINTED ANSWER SHEETS, ALL IN THE FIELD OF LANGUAGE PROFICIENCY EVALUATION; EDUCATIONAL BOOKS, PAPER TEACHING MATERIALS, STUDY GUIDES, WORKBOOKS AND COMPUTER PROGRAM MANUALS, ALL IN THE FIELD OF LANGUAGE INSTRUCTION AND LEARNING AND LANGUAGE PROFICIENCY TEST PREPARATION EDUCATIONAL SERVICES, namely, CREATING, ADMINISTERING, SCORING AND REPORTING AN INTERNET-BASED LANGUAGE PROFICIENCY TEST; PROFESSIONAL DEVELOPMENT WORKSHOPS IN THE FIELD OF LANGUAGE INSTRUCTION AND LEARNING AND LANGUAGE PROFICIENCY TEST PREPARATION PROVIDING TEMPORARY USE OF NON-DOWNLOADABLE ON-LINE SOFTWARE FOR AN INTERNET-BASED LANGUAGE PROFICIENCY TEST; SOFTWARE DEVELOPMENT, namely, DEVELOPMENT OF AN INTERNET-BASED LANGUAGE PROFICIENCY TEST

Abstract

Systems and methods are provided for scoring video clips using visual feature extraction. A signal including a video clip of a subject is received. For each frame of the video clip, physiological features of the subject visually rendered in the video clip are extracted. A plurality of visual words associated with the extracted physiological features are determined. A document including the plurality of visual words is generated. A plurality of feature vectors associated with the document are determined. The plurality of feature vectors to a regression model for scoring are provided.

IPC Classes  ?

• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• G06K 9/62 - Methods or arrangements for recognition using electronic means
• G06Q 10/10 - Office automationTime management
• G06N 5/04 - Inference or reasoning models

Abstract

Systems and methods for training raters to rate constructed responses to tasks are described herein. In one embodiment, a plurality of trainee raters are selected without regard to their prior experience. The trainee raters are then train in individual training sessions, during which they are asked to rate responses to a task. Each session presents to the trainee rater the task, a rating rubric, and training responses to the task. The training program receives ratings assigned by the trainee rater to the training responses through a graphical user interface. Upon receiving the assigned rating, the training program presents feedback substantially immediately and determines a score for the trainee rater's assigned rating. Thereafter, qualified raters are selected from the plurality of trainee raters based upon their performance during the training sessions as compared with a statistical model. Operational constructed responses are then assigned to rated by the qualified raters.

IPC Classes  ?

• G09B 19/00 - Teaching not covered by other main groups of this subclass
• G09B 7/00 - Electrically-operated teaching apparatus or devices working with questions and answers
• G09B 7/02 - Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by the student
• G06Q 50/20 - Education
• G09B 5/00 - Electrically-operated educational appliances

Abstract

Systems and methods for identifying a person's native language, are presented. A native language identification system, comprising a plurality of artificial neural networks, such as time delay deep neural networks, is provided. Respective artificial neural networks of the plurality of artificial neural networks are trained as universal background models, using separate native language and non-native language corpora. The artificial neural networks may be used to perform voice activity detection and to extract sufficient statistics from the respective language corpora. The artificial neural networks may use the sufficient statistics to estimate respective T-matrices, which may in turn be used to extract respective i-vectors. The artificial neural networks may use i-vectors to generate a multilayer perceptron model, which may be used to identify a person's native language, based on an utterance by the person in his or her non-native language.

IPC Classes  ?

• G10L 15/00 - Speech recognition
• G06N 3/04 - Architecture, e.g. interconnection topology
• G10L 15/16 - Speech classification or search using artificial neural networks
• G10L 25/78 - Detection of presence or absence of voice signals
• G06N 3/08 - Learning methods
• G09B 19/04 - Speaking

Abstract

Computer-implemented systems and methods for generating a personalization score for a constructed response are provided. A constructed response generated by a user is received. The constructed response is processed with a processing system to generate one or more feature values representative of one or more aspects of the constructed response. A personalization score for the constructed response is generated using the processing system by applying a computer scoring model to the one or more feature values. The personalization score provides a measure of a personalization of the constructed response.

IPC Classes  ?

• G09B 19/00 - Teaching not covered by other main groups of this subclass

Goods & Services

Downloadable software in the nature of a mobile application featuring educational content for use by teachers for curriculum and lesson planning and for providing professional development training focused on targeted recommendations of formative educational assessment practices; downloadable electronic publications, namely, guides, books and manuals for use by teachers for curriculum and lesson planning and professional development Educational services, namely, providing professional development training in the fields of educational assessments, curriculum and lesson planning Providing temporary use of non-downloadable computer software featuring educational content for use by teachers for curriculum and lesson planning and for providing professional development training focused on targeted recommendations of formative educational assessment practices

Abstract

Computer-implemented systems and methods are provided for scoring content of a spoken response to a prompt. A scoring model is generated for a prompt, where generating the scoring model includes generating a transcript for each of a plurality of training responses to the prompt, dividing the plurality of training responses into clusters based on the transcripts of the training responses, selecting a subset of the training responses in each cluster for scoring, scoring the selected subset of training responses for each cluster, and generating content training vectors using the transcripts from the scored subset. A transcript is generated for a received spoken response to be scored, and a similarity metric is computed between the transcript of the spoken response to be scored and the content training vectors. A score is assigned to the spoken response based on the determined similarity metric.

IPC Classes  ?

• G09B 7/02 - Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by the student
• G10L 15/01 - Assessment or evaluation of speech recognition systems
• G10L 15/06 - Creation of reference templatesTraining of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice

Abstract

Systems and methods are described for providing a multi-modal evaluation of a presentation. A system includes a motion capture device configured to detect motion an examinee giving a presentation and an audio recording device configured to capture audio of the examinee giving the presentation. One or more data processors are configured to extract a non-verbal feature of the presentation based on data collected by the motion capture device and an audio feature of the presentation based on data collected by the audio recording device. The one or more data processors are further configured to generate a presentation score based on the non-verbal feature and the audio feature.

IPC Classes  ?

• G09B 19/00 - Teaching not covered by other main groups of this subclass

Goods & Services

Providing a database of test content, namely, item text, graphics, scripts for audio recordings, scoring information and metadata, all in the field of educational testing and assessment

Goods & Services

Audio and video recordings, pre-recorded computer programs and computer programs downloadable from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research and standardized testing; interactive computer software to assist in curriculum development, curriculum management and the development of instructional programs for teachers, schools, school districts and educational service regions; database management software for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; interactive multimedia software programs for mobile platforms for English language learning; downloadable publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books for use in preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and in researching educational programs and services; downloadable software in the nature of a mobile application featuring content for testing language proficiency, for preparing for and practicing tests of language proficiency and for vocabulary enrichment; downloadable computer based tests for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; computer search engine software; downloadable computer software featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application for use in preparation for educational, occupational proficiency, workplace productivity and work skills testing and assessments and in researching educational programs and services and job skills and careers; downloadable software in the nature of a mobile application for use in preparation for testing and assessments related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable electronic publications, namely, e-books, study guides, review materials, practice exams, score reports, and downloadable audio and video recordings featuring test preparation materials for preparing for and practicing tests of English language proficiency; downloadable electronic publications, namely, e-books, study guides, review materials, practice exams, score reports, and downloadable audio and video recordings for teacher training coursework in the field of language instruction and learning and English language proficiency; downloadable software for use by teachers and educators of English language learners that provides teachers and educators with access to instructional materials and classroom activities designed to personalize instruction for English language learners. Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, guides, pamphlets, posters, rosters, printed reports, vouchers, summaries and papers pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books and booklets used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement, aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations; printed publications, namely, books, booklets, study guides, and instructional manuals in the field of test preparation, test administration and test scoring for a series of examinations for teacher licensure and teacher certification; printed tests in the field of teacher licensure and teacher certification; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and the testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; printed publications, namely, books, informational brochures, pamphlets, circulars, instruction sheets, manuals, printed guides, research reports and newsletters, all in the field of English language proficiency testing; printed tests and printed answer sheets, all in the field of English language proficiency testing; educational books, paper teaching materials, study guides, workbooks and computer program manuals, all in the field of English language instruction and learning and English language proficiency test preparation; books, informational brochures, pamphlets, circulars, instruction sheets, manuals, printed guides, research reports and newsletters for teacher training coursework in the field of language instruction and learning and English language proficiency. Providing test registration services; online retail store services in relation to educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness. Creating, administering, scoring and reporting a paper-based, computer-based and internet-based language proficiency test; creating, administering and scoring tests of academic skills, abilities and learning; administering educational tests to measure information and communication technology proficiency; preparing, administering, scoring and reporting a series of graduate school admissions examinations; test development, test administration and test scoring services for a series of examinations for teacher licensure and teacher certification; conducting seminars, webinars and workshops in the field of test preparation, teacher licensure and teacher certification; consultation in the fields of educational testing and assessment; providing educational information about testing, namely, in the field of education; organizing in-person educational forums and conducting training workshops and seminars on graduate schools and graduate school admissions examinations; providing graduate school educational information by computer for students and educational institutions; conducting professional development workshops in the field of language instruction and learning and language proficiency test preparation; providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational consulting and training services in the field of educational practices that assist teachers and administrators in evaluating collected student performance data and designing and implementing standards-based instruction based thereon to improve academic achievement; educational services, namely, curriculum and instruction design and implementation services; analysis and assessment of educational curriculum; training and educational consultation services in the field of elementary, middle and high school education; assessment and evaluation of student achievement, proficiency and skill level based on established state educational standards; development of research-based diagnostic tools, namely, printed materials, to assist schools and school districts in evaluating their curriculum and instructional programs to ensure students meet established state educational standards; conducting research and studies with respect to educational testing and test theory; providing an online database featuring graduate school information and guidance for students and educational institutions; providing graduate school guidance, assessment and placement services; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing an interactive website providing educators, parents and students with educational information and counseling about standardized tests and K-12 education; providing weblinks to informational sites of others regarding educational issues; publication of booklets, leaflets and brochures regarding K-12 education and standardized testing; providing written text editing delivered via the internet; providing an online searchable database featuring educational research and validity studies in the field of educational achievement, aptitude and assessment; providing online educational assessments; educational services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing test score reporting services; educational services, namely, providing essay scores and writing skills evaluations to students and teachers via the internet; educational services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict college students' success; educational services, namely, providing internships and fellowships in the field of educational research; providing online and in-person courses and workshops for teachers and educators in the field of English language learners, language instruction and English language proficiency testing; providing test preparation services for tests of English language proficiency; providing online non-downloadable pre-recorded videos related to tests of English language proficiency; providing online non-downloadable test preparation materials in the nature of e-books, study guides, review materials, practice exams, score reports, and downloadable audio and video for preparing for and practicing tests of English language proficiency; educational services, namely, providing online and mobile application based placement tests in the field of English language proficiency; online journals, namely, blogs and vlogs featuring non-downloadable publications in the nature of research articles, news articles and information in the field of English language learning, educational skills and workplace assessments, literacy, diversity, higher education, K-12 and adult education, and teaching and learning; Providing online training via instruction, eLearning modules in the nature of interactive lessons, interactive educational activities, virtual educational worlds, and non-downloadable videos, all in the field of improving learning, writing, reading and English language speaking skills. Providing temporary use of non-downloadable online software for an internet-based language proficiency test; providing temporary use of non-downloadable online software for the administration of a series of examinations for teacher licensure and teacher certification; development of research-based diagnostic tools, namely, computer software, to assist schools and school districts in evaluating their curriculum and instructional programs to ensure students meet established state educational standards; conducting research and validity studies in the field of educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment; providing temporary use of non-downloadable online software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable online software for an internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing temporary use of non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing a website featuring temporary use of non-downloadable software that enables users to take practice exams to determine readiness for high school-level proficiency and higher education and workplace readiness examinations; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of non-downloadable technology for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing a website featuring a search engine for measuring, scoring and reporting on workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing temporary use of non-downloadable online software for use by teachers and educators of English language learners that provides teachers and educators with access to instructional materials and classroom activities designed to personalize instruction for English language learners.

Abstract

Systems and methods are provided for automatically scoring a constructed response. The constructed response is processed to generate a plurality of numerical vectors that is representative of the constructed response. A model is applied to the plurality of numerical vectors. The model includes an input layer configured to receive the plurality of numerical vectors, the input layer being connected to a following layer of the model via a first plurality of connections. Each of the connections has a first weight. An intermediate layer of nodes is configured to receive inputs from an immediately-preceding layer of the model via a second plurality of connections, each of the connections having a second weight. An output layer is connected to the intermediate layer via a third plurality of connections, each of the connections having a third weight. The output layer is configured to generate a score for the constructed response.

IPC Classes  ?

• G06N 7/02 - Computing arrangements based on specific mathematical models using fuzzy logic
• G06N 7/04 - Physical realisation
• G06N 7/06 - Simulation on general purpose computers
• G06N 7/08 - Computing arrangements based on specific mathematical models using chaos models or non-linear system models
• G06N 3/04 - Architecture, e.g. interconnection topology
• G06N 3/08 - Learning methods

Goods & Services

Audio and video recordings, pre-recorded computer programs and computer programs downloadable from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research and standardized testing; downloadable interactive computer software to assist in curriculum development, curriculum management and the development of instructional programs for teachers, schools, school districts and educational service regions; downloadable database management software for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; downloadable interactive multimedia software programs for mobile platforms for English language learning; downloadable publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books for use in preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and in researching educational programs and services; downloadable software in the nature of a mobile application featuring content for testing language proficiency, for preparing for and practicing tests of language proficiency and for vocabulary enrichment; downloadable computer based software featuring tests for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; downloadable computer search engine software; downloadable computer software featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application for use in preparation for educational, occupational proficiency, workplace productivity and work skills testing and assessments and in researching educational programs and services and job skills and careers; downloadable software in the nature of a mobile application for use in preparation for testing and assessments related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable electronic publications, namely, e-books, study guides, teaching review materials, practice exams, and score reports in the field of English language proficiency testing, and downloadable audio and video recordings featuring test preparation materials for preparing for and practicing tests of English language proficiency; downloadable electronic publications, namely, e-books, study guides, teaching review materials, practice exams, and score reports for teacher training coursework in the field of language instruction and learning and English language proficiency, and downloadable audio and video recordings for teacher training coursework in the field of language instruction and learning and English language proficiency; downloadable software for use by teachers and educators of English language learners that provides teachers and educators with access to instructional materials and classroom activities designed to personalize instruction for English language learners Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, guides, pamphlets, posters, rosters, printed reports, vouchers, summaries and papers pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books and booklets used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement, aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations; printed publications, namely, books, booklets, study guides, and instructional manuals in the field of test preparation, test administration and test scoring for a series of examinations for teacher licensure and teacher certification; printed tests in the field of teacher licensure and teacher certification; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and the testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; printed publications, namely, books, informational brochures, pamphlets, circulars, instruction sheets, manuals, printed guides, research reports and newsletters, all in the field of English language proficiency testing; printed tests and printed answer sheets, all in the field of English language proficiency testing; educational books, paper teaching materials, study guides, workbooks and printed computer program manuals, all in the field of English language instruction and learning and English language proficiency test preparation; books, informational brochures, pamphlets, circulars, instruction sheets, manuals, printed guides, research reports and newsletters for teacher training coursework in the field of language instruction and learning and English language proficiency Providing test registration services for educational administration purposes; online retail store services featuring educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, testing to determine employment skills in the nature of test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness Educational testing services, namely, creating, administering, scoring and reporting a paper-based, computer-based and internet-based language proficiency test; educational testing services, namely, creating, administering and scoring tests of academic skills, abilities and learning; educational testing services, namely, administering educational tests to measure information and communication technology proficiency; educational testing services, namely, preparing, administering, scoring and reporting a series of graduate school admissions examinations; educational testing services, namely, test development, test administration and test scoring services for a series of examinations for teacher licensure and teacher certification; conducting seminars and providing non-downloadable webinars and workshops in the field of test preparation, teacher licensure and teacher certification; consultation in the fields of educational testing and assessment; providing educational information about testing, namely, in the field of education; organizing in-person educational forums and conducting training workshops and seminars on graduate schools and graduate school admissions examinations; providing graduate school educational information, namely, providing information in the field of graduate school education by computer for students and educational institutions; conducting professional development workshops in the field of language instruction and learning and language proficiency test preparation; providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational consulting and training services in the field of educational practices that assist teachers and administrators in evaluating collected student performance data and designing and implementing standards-based instruction based thereon to improve academic achievement; educational services, namely, curriculum and instruction design and implementation services in the nature of developing curriculum for educators; analysis and assessment of educational curriculum, namely, providing educational assessment services of educational curriculum; training and educational consultation services in the field of elementary, middle and high school education; assessment and evaluation, namely, educational assessment of student achievement, proficiency and skill level based on established state educational standards; development of research-based diagnostic tools, namely, development of printed educational materials of others in the field of educational assessment, to assist schools and school districts in evaluating their curriculum and instructional programs to ensure students meet established state educational standards; conducting research and studies with respect to educational testing and test theory; providing an online database featuring graduate school information and guidance for students and educational institutions; educational counseling services to assist students in planning and preparing for further education in the nature of providing graduate school guidance, assessment and placement services; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing an interactive website providing educators, parents and students with educational information and counseling about standardized tests and K-12 education; providing an Internet website portal featuring web links to informational sites of others regarding educational issues; publication of booklets, leaflets and brochures regarding K-12 education and standardized testing; providing written text editing delivered via the internet; providing an online searchable database featuring educational research and validity studies in the field of educational achievement, aptitude and assessment; providing online educational assessments; educational testing services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; educational testing services, namely, providing test score reporting services; educational assessment services, namely, providing essay scores and writing skills evaluations to students and teachers via the internet; educational assessment services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict college students' success; educational services, namely, providing internships and fellowships in the field of educational research; providing online and in-person education courses and workshops for teachers and educators in the field of English language learners, language instruction and English language proficiency testing; providing test preparation services, namely, preparing, administering, and scoring academic for tests of English language proficiency; providing online non-downloadable pre-recorded videos related to tests of English language proficiency; providing online non-downloadable test preparation materials in the nature of e-books, study guides, teaching review materials, practice exams, and score reports in the field of English language proficiency testing; Online journals, namely, blogs and vlogs featuring non-downloadable publications in the nature of research articles, news articles and information in the field of English language learning, educational skills and workplace assessments, literacy, diversity, higher education, K-12 and adult education, and teaching and learning; Providing online training via instruction, eLearning modules in the nature of interactive lessons, interactive educational activities, virtual educational worlds, and non-downloadable videos, all in the field of improving learning, writing, reading and English language speaking skills Providing temporary use of non-downloadable online software for an internet-based language proficiency test; providing temporary use of non-downloadable online software for the administration of a series of examinations for teacher licensure and teacher certification; development of research-based diagnostic tools, namely, computer software, to assist schools and school districts in evaluating their curriculum and instructional programs to ensure students meet established state educational standards; conducting research and validity studies, namely, scientific research in the field of educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment; providing temporary use of non-downloadable online software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable online software for an internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing temporary use of on-line non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing a website featuring temporary use of non-downloadable software that enables users to take practice exams to determine readiness for high school-level proficiency and higher education and workplace readiness examinations; providing temporary use of on-line non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of on-line non-downloadable software featuring technology for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing a website featuring a search engine for measuring, scoring and reporting on workplace productivity, work skills and occupational proficiencies and workplace adaptation; providing temporary use of non-downloadable online software for use by teachers and educators of English language learners that provides teachers and educators with access to instructional materials and classroom activities designed to personalize instruction for English language learners; providing temporary use of on-line non-downloadable applications for placement tests in the field of English language proficiency

Goods & Services

Books, informational brochures, pamphlets, circulars, instruction sheets, manuals, printed guides, research reports and newsletters, all in the field of English language proficiency testing; printed tests and printed answer sheets, all in the field of English language proficiency testing; educational books, paper teaching materials, study guides, workbooks and printed computer program manuals, all in the field of English language instruction and learning and English language proficiency test preparation; books, informational brochures, pamphlets, circulars, instruction sheets, manuals, printed guides, research reports and newsletters for teacher training coursework in the field of language instruction and learning and English language proficiency Educational testing services, namely, creating, administering, scoring and reporting an internet-based language proficiency test; providing professional development workshops in the field of English language learners, language instruction and English language proficiency testing; providing online and in-person education courses and workshops for teachers and educators in the field of English language learners, language instruction and English language proficiency testing; providing test preparation services, namely, preparing, administering, and scoring academic tests of English language proficiency; providing online non-downloadable pre-recorded videos related to tests of English language proficiency; providing information relating to educational testing, namely, tests of English language proficiency and test administrations; providing online non-downloadable test preparation materials in the nature of e-books, study guides, teaching review materials, practice exams, and score reports in the field of English language proficiency testing; educational testing services in the nature of development and administration of an internet-based language proficiency test Providing temporary use of non-downloadable online software for an internet-based language proficiency test; providing temporary use of non-downloadable online software for use by teachers and educators of English language learners that provides teachers and educators with access to instructional materials and classroom activities designed to personalize instruction for English language learners; providing temporary use of on-line non-downloadable applications for placement tests in the field of English language proficiency

Goods & Services

Downloadable electronic publications, namely, e-books, study guides, teaching review materials, practice exams, and score reports in the field of English language proficiency testing, and downloadable audio and video recordings featuring test preparation materials for preparing for and practicing tests of English language proficiency; downloadable electronic publications, namely, e-books, study guides, teaching review materials, practice exams, and score reports for teacher training coursework in the field of language instruction and learning and English language proficiency, and downloadable audio and video recordings for teacher training coursework in the field of language instruction and learning and English language proficiency; downloadable software for use by teachers and educators of English language learners that provides teachers and educators with access to instructional materials and classroom activities designed to personalize instruction for English language learners Books, informational brochures, pamphlets, circulars, instruction sheets, manuals, printed guides, research reports and newsletters, all in the field of English language proficiency testing; printed tests and printed answer sheets, all in the field of English language proficiency testing; educational books, paper teaching materials, study guides, workbooks and printed computer program manuals, all in the field of English language instruction and learning and English language proficiency test preparation; books, informational brochures, pamphlets, circulars, instruction sheets, manuals, printed guides, research reports and newsletters for teacher training coursework in the field of language instruction and learning and English language proficiency Educational testing services, namely, creating, administering, scoring and reporting an internet-based language proficiency test; providing professional development workshops in the field of English language learners, language instruction and English language proficiency testing; providing online and in-person education courses and workshops for teachers and educators in the field of English language learners, language instruction and English language proficiency testing; providing test preparation services, namely, preparing, administering, and scoring academic tests of English language proficiency; providing online non-downloadable pre-recorded videos related to tests of English language proficiency; providing information relating to educational testing, namely, tests of English language proficiency and test administrations; providing online non-downloadable test preparation materials in the nature of e-books, study guides, teaching review materials, practice exams, and score reports in the field of English language proficiency testing; educational testing services in the nature of development and administration of an internet-based language proficiency test Providing temporary use of non-downloadable online software for an internet-based language proficiency test; providing temporary use of non-downloadable online software for use by teachers and educators of English language learners that provides teachers and educators with access to instructional materials and classroom activities designed to personalize instruction for English language learners; providing temporary use of on-line non-downloadable applications for placement tests in the field of English language proficiency

Goods & Services

Downloadable software in the nature of a mobile application for use in preparing for and practicing standardized tests of language proficiency; downloadable electronic publications, namely, ebooks, booklets and score reports for preparing for and practicing standardized tests of language proficiency Books, informational brochures, pamphlets, circulars, instruction sheets, manuals, printed guides, research reports and newsletters, all in the field of language proficiency testing and evaluation; printed tests and printed answer sheets, all in the field of language proficiency evaluation; educational books, paper teaching materials, study guides, workbooks and computer program manuals, all in the field of language instruction and learning and language proficiency test preparation Educational services, namely, creating, administering, scoring and reporting an internet-based language proficiency test; professional development workshops in the field of language instruction and learning and language proficiency test preparation Development and administration of an internet-based language proficiency test

Goods & Services

(1) Providing temporary use of non-downloadable on-line software for a computer-based reading assessment; Providing temporary use of non-downloadable on-line software for administering, scoring and analyzing the results of academic standardized reading tests

Goods & Services

Downloadable educational mobile application featuring instruction for improving language arts skills in the field of reading and listening providing temporary use of a non-downloadable web-based educational application featuring instruction for improving language arts skills in the field of reading and listening

Goods & Services

Providing educational assessment services, namely, reporting to others test results data in the field of English language proficiency

Goods & Services

Educational services, namely, providing essay scores and writing skills evaluations to students and teachers via the Internet

Goods & Services

RETAIL STORE SERVICES FEATURING INTERNET-DELIVERED TEACHING AND LEARNING EDUCATIONAL MATERIALS; MAIL ORDER SERVICES FEATURING INTERNET-DELIVERED TEACHING AND LEARNING EDUCATIONAL MATERIALS; ON-LINE RETAIL STORE SERVICES FEATURING INTERNET-DELIVERED TEACHING AND LEARNING EDUCATIONAL MATERIALS; INDEPENDENT SALES REPRESENTATIVES IN THE FIELD OF INTERNET-DELIVERED TEACHING AND LEARNING EDUCATIONAL MATERIALS AND SERVICES TEST ADMINISTRATION SERVICES, NAMELY, ADMINISTRATION OF A STANDARDIZED EDUCATIONAL TEST; TEST SCORING SERVICES AND TEST SCORE REPORTING SERVICES

Goods & Services

Platform as a services (PAAS) featuring computer software platforms for use by higher education institutions to search, expand and encourage efficient engagement and advancement of students' graduate and language studies by use of a variety of search criteria, such as demographics, geographic data, academic disciplines and test scores

Goods & Services

Audio recordings on disc featuring content for preparing for and practicing tests of English proficiency; prerecorded computer software for preparing for and practicing tests of English language proficiency in the field of educational testing related to examinations of English proficiency; downloadable electronic publications, namely, handbooks and practice tests for preparing for tests of English language proficiency. Printed materials, namely, manuals, booklets, tests, test answer sheets, printed teaching materials and score reports for use in testing English language proficiency. Educational services, namely, preparing, administering and scoring tests of English language proficiency; providing information relating to English language proficiency tests.

Goods & Services

Providing temporary use of non-downloadable computer software for use in measuring, scoring and evaluating English language oral communication proficiencies and for providing feedback on the assessment of such proficiencies

Goods & Services

Audio recordings featuring content for preparing for testing language proficiency and for testing of language proficiency; computer programs downloadable from a global computer network used for preparing for and practicing standardized tests of language proficiency; downloadable electronic publications, including books, booklets and score reports for preparing for tests of language proficiency. Printed publications, including books, booklets, pamphlets, instruction sheets, manuals and printed guides, all in the field of language proficiency testing and evaluation; printed tests and printed answer sheets, all in the field of language proficiency evaluation; educational books, paper teaching materials, study guides and workbooks, all in the field of language proficiency test preparation. Educational services, including preparing, administering and scoring of a standardized language proficiency test; providing online test preparation services. Providing temporary use of non-downloadable on-line software for an internet-delivered language proficiency test.

Goods & Services

Educational services, namely, providing test preparation and test scoring services relating to graduate and business school admissions' tests. Providing temporary use of non-downloadable online software for educational test preparation and testing in the field of graduate and business school admissions.

Goods & Services

Educational services, namely, providing test preparation and test scoring services relating to graduate and business school admissions' tests. Providing temporary use of non-downloadable online software for educational test preparation and testing in the field of graduate and business school admissions.

Goods & Services

Software for preparing and practicing standardized tests.

Goods & Services

Educational services, namely, providing test preparation and test scoring services relating to graduate and business school admissions' tests Providing temporary use of non-downloadable online software for educational test preparation and testing in the field of graduate and business school admissions

Goods & Services

Educational services, namely, providing test preparation and test scoring services relating to graduate and business school admissions' tests Providing temporary use of non-downloadable online software for educational test preparation and testing in the field of graduate and business school admissions

Goods & Services

Prerecorded digital and magnetic media and prerecorded operating computer programs for use in the administration of english language proficiency tests to young learners. Educational printed materials, namely, books, manuals, workbooks, study guides, test answer sheets for use in teaching, learning and testing of english language proficiency. Retail sales of educational materials via the internet; distribution of standardized tests and test answer sheets to schools for administration to students; providing test registration services. Educational services, namely, conducting courses and workshops in the field of english language learning; administering and scoring tests of english language proficiency; providing test score reporting services; distribution of informational materials about english language proficiency tests and test administrations.

Goods & Services

Audio and video recordings, pre-recorded computer programs and computer programs downloadable from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research and standardized testing; interactive computer software to assist in curriculum development, curriculum management and the development of instructional programs for teachers, schools, school districts and educational service regions; database management software for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; interactive multimedia software programs for mobile platforms for English language learning; downloadable publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books for use in preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and in research educational programs and services; downloadable software in the nature of a mobile application featuring content for testing language proficiency, for preparing for and practicing tests of language proficiency and for vocabulary enrichment; downloadable computer-based testing software for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; computer search engine software; downloadable computer software featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application for use in preparation for educational, occupational proficiency, workplace productivity and work skills testing and assessments and in researching educational programs and services and job skills and careers; downloadable software in the nature of a mobile application for use in preparation for testing and assessments related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates. Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, guides, pamphlets, posters, rosters, printed reports, vouchers, summaries and papers pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books and booklets used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement, aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations; printed publications, namely, books, booklets, study guides, and instructional manuals in the field of test preparation, test administration and test scoring for a series of examinations for teacher licensure and teacher certification; printed tests in the field of teacher licensure and teacher certification; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness. Online retail store services featuring educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness. Developing, administering and evaluating educational scholarship programs. Creating, administering, scoring and reporting a paper-based, computer-based and Internet-based language proficiency test; creating, administering and scoring tests of academic skills, abilities and learning; administering educational tests to measure information and communication technology proficiency; preparing, administering, scoring and reporting a series of graduate school admissions examinations; test development, test administration and test scoring services for a series of examinations for teacher licensure and teacher certification; conducting seminars, webinars and workshops in the field of test preparation, teacher licensure and teacher certification; consultation in the fields of educational testing and assessment; providing information about testing, namely, in the field of education; organizing forums and conducting training workshops and seminars on graduate schools and graduate school admissions examinations; providing graduate school information by computer for students and educational institutions; professional development workshops in the field of language instruction and learning and language proficiency test preparation; providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational consulting and training services in the field of educational practices that assist teachers and administrators in evaluating collected student performance data and designing and implementing standards-based instruction based thereon to improve academic achievement; educational services, namely, curriculum and instruction design and implementation services; analysis and assessment of educational curriculum; training and consultation services in the field of elementary, middle and high school education; assessment and evaluation of student achievement, proficiency and skill level based on established state educational standards; development of research-based diagnostic tools, namely, printed materials, to assist schools and school districts evaluate their curriculum and instructional programs to ensure all students meet established state educational standards; conducting research and studies with respect to educational testing and test theory; provision of graduate school information and guidance for students and educational institutions via an online database; providing graduate school guidance, assessment and placement services; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing information and counseling about standardized tests and K-12 education for educators, parents and students via an interactive website; information services on educational issues by providing hypertext links to the web sites of others; publication of booklets, leaflets and brochures regarding K-12 education and standardized testing; providing written text editing delivered via the Internet; providing information featuring educational research and validity studies in the field of educational achievement, aptitude and assessment via an online searchable database; providing online educational assessments; providing test registration services; educational services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and Internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing test score reporting services; educational services, namely, providing essay scores and writing skills evaluations to students and teachers via the Internet; educational services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict college students' success; educational services, namely, providing internships and fellowships in the field of educational research. Providing temporary use of non-downloadable online software for an Internet-based language proficiency test; providing temporary use of non-downloadable online software for the administration of a series of examinations for teacher licensure and teacher certification; development of research-based diagnostic tools, namely, computer software, to assist schools and school districts evaluate their curriculum and instructional programs to ensure all students meet established state educational standards; conducting research and validity studies in the field of educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment; providing temporary use of non-downloadable on-line software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable on-line software for an Internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing temporary use of non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; hosting a website featuring temporary use of non-downloadable software that enables users to take practice exams to determine readiness for high school-level proficiency and higher education and workplace readiness examinations; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of non-downloadable computer software for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; hosting a website featuring a search engine for measuring, scoring and reporting on workplace productivity, work skills and occupational proficiencies and workplace adaptation.

Goods & Services

Audio and video recordings, pre-recorded computer programs and computer programs downloadable from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research and standardized testing; interactive computer software to assist in curriculum development, curriculum management and the development of instructional programs for teachers, schools, school districts and educational service regions; database management software for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; interactive multimedia software programs for mobile platforms for English language learning; downloadable publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books for use in preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and in research educational programs and services; downloadable software in the nature of a mobile application featuring content for testing language proficiency, for preparing for and practicing tests of language proficiency and for vocabulary enrichment; downloadable computer-based testing software for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with job placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; computer search engine software; downloadable computer software featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application featuring content for testing and preparing for testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable electronic publications, namely, certificates, score reports and performance assessments in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; downloadable software in the nature of a mobile application for use in preparation for educational, occupational proficiency, workplace productivity and work skills testing and assessments and in researching educational programs and services and job skills and careers; downloadable software in the nature of a mobile application for use in preparation for testing and assessments related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates. Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, guides, pamphlets, posters, rosters, printed reports, vouchers, summaries and papers pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books and booklets used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement, aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations; printed publications, namely, books, booklets, study guides, and instructional manuals in the field of test preparation, test administration and test scoring for a series of examinations for teacher licensure and teacher certification; printed tests in the field of teacher licensure and teacher certification; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates; educational printed materials, namely, books, manuals, workbooks, study guides, instructor guides, tests, test answer sheets and score reports for use in teaching, learning and testing of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness. Online retail store services featuring educational materials and job and career readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness. Developing, administering and evaluating educational scholarship programs. Creating, administering, scoring and reporting a paper-based, computer-based and Internet-based language proficiency test; creating, administering and scoring tests of academic skills, abilities and learning; administering educational tests to measure information and communication technology proficiency; preparing, administering, scoring and reporting a series of graduate school admissions examinations; test development, test administration and test scoring services for a series of examinations for teacher licensure and teacher certification; conducting seminars, webinars and workshops in the field of test preparation, teacher licensure and teacher certification; consultation in the fields of educational testing and assessment; providing information about testing, namely, in the field of education; organizing forums and conducting training workshops and seminars on graduate schools and graduate school admissions examinations; providing graduate school information by computer for students and educational institutions; professional development workshops in the field of language instruction and learning and language proficiency test preparation; providing training programs, educational conferences, workshops, courses, and seminars in the fields of education reform, curriculum development and enrichment; educational consulting and training services in the field of educational practices that assist teachers and administrators in evaluating collected student performance data and designing and implementing standards-based instruction based thereon to improve academic achievement; educational services, namely, curriculum and instruction design and implementation services; analysis and assessment of educational curriculum; training and consultation services in the field of elementary, middle and high school education; assessment and evaluation of student achievement, proficiency and skill level based on established state educational standards; development of research-based diagnostic tools, namely, printed materials, to assist schools and school districts evaluate their curriculum and instructional programs to ensure all students meet established state educational standards; conducting research and studies with respect to educational testing and test theory; provision of graduate school information and guidance for students and educational institutions via an online database; providing graduate school guidance, assessment and placement services; providing recognition and incentives by the way of awards to demonstrate excellence in the field of teaching; providing information and counseling about standardized tests and K-12 education for educators, parents and students via an interactive website; information services on educational issues by providing hypertext links to the web sites of others; publication of booklets, leaflets and brochures regarding K-12 education and standardized testing; providing written text editing delivered via the Internet; providing information featuring educational research and validity studies in the field of educational achievement, aptitude and assessment via an online searchable database; providing online educational assessments; providing test registration services; educational services, namely, preparing, administering, scoring and analyzing a paper-based, computer-based and Internet-based standardized test in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing test score reporting services; educational services, namely, providing essay scores and writing skills evaluations to students and teachers via the Internet; educational services, namely, providing, administering and scoring online non-cognitive assessments for the purpose of measuring factors to predict college students' success; educational services, namely, providing internships and fellowships in the field of educational research. Providing temporary use of non-downloadable online software for an Internet-based language proficiency test; providing temporary use of non-downloadable online software for the administration of a series of examinations for teacher licensure and teacher certification; development of research-based diagnostic tools, namely, computer software, to assist schools and school districts evaluate their curriculum and instructional programs to ensure all students meet established state educational standards; conducting research and validity studies in the field of educational achievement, aptitude and examinations for scoring, measuring, evaluating and storing information related to an individual's assessment; providing temporary use of non-downloadable on-line software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; providing temporary use of non-downloadable on-line software for an Internet-based standardized test for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; providing temporary use of non-downloadable software for administering, scoring and analyzing standardized tests for educational testing in the fields of language arts, reading, writing, mathematics, science and social studies for purposes of evaluating high school-level proficiency and higher education and workplace readiness; hosting a website featuring temporary use of non-downloadable software that enables users to take practice exams to determine readiness for high school-level proficiency and higher education and workplace readiness examinations; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of non-downloadable computer software for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; hosting a website featuring a search engine for measuring, scoring and reporting on workplace productivity, work skills and occupational proficiencies and workplace adaptation.

Goods & Services

Audio and video recordings, pre-recorded computer programs and computer programs downloadable from a global computer network, all used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement and aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations and educational and professional testing and assessment of skills, abilities, learning and achievement; downloadable electronic publications in the nature of informational booklets, books, pamphlets, newsletters, brochures and score reports in the field of test preparation, test information, test scoring for teacher licensure and teacher certification, education, educational research and standardized testing; interactive computer software to assist in curriculum development, curriculum management and the development of instructional programs for teachers, schools, school districts and educational service regions; database management software for the management of K-12 academic assessment tools, for test scoring, test score reporting, and evaluation of instructional programs, all designed to meet established state educational standards; interactive multimedia software programs for mobile platforms for English language learning; downloadable publications, namely, tests, books, booklets, study guides, manuals and score reports in the field of workplace productivity, work skills and occupational proficiencies; downloadable e-books for use in preparation for admissions examinations, instructional assessment and training, professional and educational assessments, and in research educational programs and services; downloadable software in the nature of a mobile application featuring content for testing language proficiency, for preparing for and practicing tests of language proficiency and for vocabulary enrichment; downloadable software in the nature of a mobile application for use in preparation for educational, occupational proficiency, workplace productivity and work skills testing and assessments and in researching educational programs and services and workforce skills and careers; downloadable software in the nature of a mobile application for use in preparation for testing and assessments related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer based tests for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job adaptation and identifying job candidates; downloadable computer software for scoring, measuring, evaluating and storing information related to workplace productivity, work skills and occupational proficiency measurements to assist with workforce placement; downloadable computer software for use in preparation for workplace productivity, work skills and occupational proficiency testing and assessments; computer search engine software. Paper goods and printed matter, namely, printed test forms and test booklets, booklets, books, newsletters, printed certificates, manuals, guides, pamphlets, posters, rosters, printed reports, vouchers, summaries and papers pertaining to test preparation, educational and professional testing and assessment of skills, abilities, learning and achievement; printed publications, namely, books and booklets used for preparing for and practicing standardized tests of literacy, basic academic skills, academic achievement, aptitude, language proficiency and for use in researching graduate school programs and preparing for graduate school admissions examinations; printed publications, namely, books, booklets, study guides, and instructional manuals in the field of test preparation, test administration and test scoring for a series of examinations for teacher licensure and teacher certification; printed tests in the field of teacher licensure and teacher certification; printed publications, namely, books, booklets, study guides, manuals and score reports in the field of productivity, non-cognitive skills and proficiency assessments; printed tests for measuring and evaluating an individual's productivity levels, non-cognitive skills and proficiencies related to job placement, job adaptation and identifying job candidates. Online retail store services featuring educational materials and workforce readiness materials; consultation in the field of professional assessment for purposes of improving professional competency; business services to determine employment skills and to evaluate occupational proficiency, namely, test development, test administration and test scoring services for examinations that measure and evaluate an individual's productivity, non-cognitive skills, and job adaptation and readiness; providing test registration services. Developing, administering and evaluating educational scholarship programs. Creating, administering, scoring and reporting a paper-based, computer-based and Internet-based language proficiency test; creating, administering and scoring tests of academic skills, abilities and learning; administering educational tests to measure information and communication technology proficiency; preparing, administering, scoring and reporting a series of graduate school admissions examinations; test development, test administration and test scoring services for a series of examinations for teacher licensure and teacher certification; assessment and evaluation of student achievement, proficiency and skill level based on established state educational standards; conducting research and studies with respect to educational testing and test theory; providing written text editing delivered via the Internet; providing graduate school guidance, assessment and graduate school placement services; providing online educational assessments. Providing temporary use of non-downloadable online software for an Internet-based language proficiency test; providing temporary use of non-downloadable online software for providing essay scoring and writing skills evaluations to students and teachers via the Internet; providing temporary use of non-downloadable online software for the administration of a series of examinations for teacher licensure and teacher certification; development of research-based diagnostic tools, namely, computer software, to assist schools and school districts evaluate their curriculum and instructional programs to ensure all students meet established state educational standards; conducting scientific research and validity studies in the field of educational achievement, aptitude and assessment; providing temporary use of non-downloadable online software for the administration of examinations for scoring, measuring, evaluating and storing information related to an individual's productivity levels, non-cognitive skills and proficiencies for job placement, job and identifying job candidates; providing temporary use of non-downloadable software that identifies job candidates who are likely to succeed in particular work environments; providing temporary use of non-downloadable technology for the administration of a series of examinations for workplace productivity, work skills and occupational proficiencies and workplace adaptation; hosting a website featuring a search engine for measuring, scoring and reporting on workplace productivity, work skills and occupational proficiencies and workplace adaptation.

Goods & Services

Electronic downloadable documents, namely, manuals, score reports, forms and other documents related to administration of computer-based cognitive and non-cognitive educational assessments, downloadable to a computer or mobile device via the internet. Educational services in the nature of development, administration and scoring of computer-based cognitive and non-cognitive educational assessments, namely, preparing, administering, and scoring academic standardized tests. Providing online non-downloadable computer software programs to deliver and provide access to computer-based cognitive and non-cognitive educational assessments and score reports via the internet; development of computer software for the administration and scoring of computer-based cognitive and non-cognitive educational assessments.

Abstract

Systems and methods are provided for identifying one or more target words of a corpus that have a lexical relationship to a plurality of provided cue words. The cue words and statistical lexical information derived from a corpus of documents are analyzed to determine candidate words that have a lexical association with the cue words. The statistical information includes numerical values indicative of probabilities of word pairs appearing together as adjacent words in a well-formed text or appearing together within a paragraph of a well-formed text. For each candidate word, a statistical association score between the candidate word and each of the cue words is determined. An aggregate score for each of the candidate words is determined based on the statistical association scores. One or more of the candidate words are selected to be the one or more target words based on the aggregate scores.

IPC Classes  ?

• G06F 17/27 - Automatic analysis, e.g. parsing, orthograph correction
• G06F 17/30 - Information retrieval; Database structures therefor
• G10L 15/06 - Creation of reference templatesTraining of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice