Working with custom qualification types
When using Amazon Mechanical Turk (Mechanical Turk), you can create qualification types that you can then assign to workers as qualifications. Qualifications can be used for a range of worker management approaches, such as identifying workers that have met certain criteria in past tasks (HITs) or assigning a score based on performance over time. The following discusses how to create and assign qualification types to workers, as well as how to modify or revoke them.
Mechanical Turk also provides the option to create qualification tests that allow workers to take a test to be assigned aqualification automatically. That topic isn't addressed here, but more information can be found in the API Documentation.
Topics
- Create a qualification type
- Assign or remove a worker qualification
- Qualification requests
- Tutorial: Creating a qualification requirement that requires workers be in a group
- Tutorial: Create a qualification requirement that workers have achieved at least 80% accuracy on previous tasks
- Tutorial: Creating a qualification type to exclude workers from selected tasks
Create a qualification type
The CreateQualificationType operation can be used to
register a new qualification type in your account. Simply specify the name, provide
a brief description, and specify Active as the status. Note that the
qualification type name and description are visible to workers. You can update these
values using the UpdateQualificationType operation.
Assign or remove a worker qualification
To assign a qualification type to a worker, use the AssociateQualificationWithWorker operation, specifying
the ID of the qualification type and the worker it should be applied to. You can
also assign an integer value such as a score. To modify the integer value, call the
AssociateQualificationWithWorker operation again with the new
value.
You can remove a qualification using the DisassociateQualificationFromWorker operation.
Qualification requests
When workers don't have one of the custom qualification types required to do your task, they have the option to request it from the Mechanical Turk marketplace. This is most commonly associated with tasks that have qualification tests but all custom qualification types can be requested.
These requests can be queried using the ListQualificationRequests operation and can be approved or
rejected using the AcceptQualificationRequest or RejectQualificationRequest operations respectively.
Additional operations
The following operations can be used when working with qualifications.
Additional Operations
-
ListQualificationTypes: Retrieves a list of your existing qualification types. -
GetQualificationType: Retrieves the details of a qualification type. -
ListWorkersWithQualificationType: Retrieves a list of workers that have been assigned a qualification type. -
ListHITsForQualificationType: Retrieves a list of HITs that include a qualification type in their requirements. -
GetQualificationScore: Retrieves the qualification assigned to a worker for a qualification type.
