초록 ▼

A method and apparatus for automatically gathering research data for a website. The method includes forming questions in a question set that are a measure of a research metric to be gathered for the website, partitioning the question set into a plurality of subsets of questions, identifying particip

A method and apparatus for automatically gathering research data for a website. The method includes forming questions in a question set that are a measure of a research metric to be gathered for the website, partitioning the question set into a plurality of subsets of questions, identifying participants to query, and only presenting a subset of questions from the question set to each participant. Responses are gathered from each participant to the questions presented for the research metric and the participants' responses are combined to produce an index of the research metric.

대표청구항 ▼

1. A method for gathering research data comprising:identifying a target website about which research data will be gathered; characterizing the target website including determining a site profile, the site profile including information for characterizing the target website content and usage; automati

1. A method for gathering research data comprising:identifying a target website about which research data will be gathered; characterizing the target website including determining a site profile, the site profile including information for characterizing the target website content and usage; automatically selecting questions from a predefined list of questions directed to a research metric based on the site profile; said selecting selects n questions; partitioning the question set into a plurality of m subsets of questions where a subset m of questions includes ri questions and where n=Σmi=1ri; identifying k participants to query; presenting one or more subsets of questions from the question set to at least one of the identified participants without presenting all of the n questions to all of the k participants and without presenting the same questions to each participant, the presenting step including gathering responses from each participant to their respective subset(s) of questions presented for the research metric coincident with a navigation of the target website by a given participant; and combining the participants' responses to produce an index of the research metric; the step of characterizing the target website further includes determining a task to be performed by a participant while navigating the target website; the step of selecting one or more subsets of questions includes selecting questions relevant to the task; and the step of presenting one or more subsets of questions from the question set to at least one of the identified participants includes presenting the one or more subsets of questions to a participant coincident with the navigation of the target website. 2. The research method of claim 1 wherein the research data can be selected from usability, product and organizational research concerning the target website.3. The research method of claim 1 further includingforming questions in a plurality of question sets that are a measure, respectively, of a plurality of research metrics to be gathered for the target website; and partitioning each question set into a plurality of subsets of questions. 4. The research method of claim 3 further includingonly presenting a subset of questions for each question set to each participant including gathering responses from each participant to the questions presented for each research metric; and combining the participant's responses to produce a plurality of indexes, one for each of the research metrics. 5. The research method of claim 3 further includingonly presenting a subset of questions for one or more question sets to each participant including gathering responses from each participant to the questions presented for each research metric; and combining the participant's responses to produce a plurality of indexes, one for each of the research metrics. 6. The research method of claim 1 further includingidentifying k participants to query includes selecting participants from among visitors to the target website including soliciting participants using pop-up invitations and screening participants to fine tune the research with respect to predefined benchmarks and wherein the step of soliciting participants includes providing a pop-up controller operable to determine an effectivity of a given pop-up invitation based in part of responses received from participants presented a given pop-up invitation. 7. The research method of claim 6 further includingidentifying one or more participant types; setting quotas for each participant type to be included in the research; and screening participants based on the quotas for inclusion in the research. 8. The research method of claim 6 further where the step of identifying participants includesselecting from visitors at the target website including displaying an invitation to a selected visitor. 9. The research method of claim 8 where the step of displaying an invitation includesproviding a palette of invitations; gathering statistical information each time an invitation is selected from the palette to measure one or more palette metrics; and selecting an invitation based on the statistics gathered for the one or more palette metrics. 10. The research method of claim 1 further includingrecording participant responses when gathering participant research data including participant behavior information describing how the participant interacted with the target website during navigation of the target website while performing a predetermined task, the participant behavior information including screen capture information for screens presented to the user while performing the predetermined task. 11. The research method of claim 10 further wherein the participant responses are selected from the group of audio, gestural and keystroke responses.12. The research method of claim 11 further including capturing a screenshot of a user interface presented to the participant from the target website and relating to one or more of the participant responses.13. The research method of claim 11 further includingdownloading a recorder to the target website; invoking the recorder when a participant navigates the target website; and uploading responses gathered by the recorder to a centralized research site for analysis. 14. The research method of claim 1 further includingincentivizing a candidate to become a participant including identifying a reward to be given to a participant upon completion of participation. 15. The research method of claim 14 wherein the step of identifying a target website includes selecting a website of a competitor as the target website.16. The research method of claim 1 further includingstoring historical results for the research metric and a representation of the target website or portion of the target website to which the metric pertains; recognizing that the target website has been updated; gathering new responses from participants to the questions presented for the research metric coincident with the participant's navigation of the updated target website; combining the participant's responses to produce an index of the research metric for the updated target website; and comparing the indexes for the target website against the target website to measure a change of the research metric between the two. 17. An apparatus for gathering research data comprising:a research module operable to identifying a target website about which research data will be gathered, characterizing the target website including determining a site profile, the site profile including information for characterizing the target website content and usage, automatically select questions from a predefined list of questions directed to a research metric based on the site profile including selecting n questions, and partitioning the question set into a plurality of m subsets of questions where a subset of m questions includes ri questions and where n=Σmi=1 ri; identifying k participants to query; a runtime engine operable to only present one or more: subsets of questions from the question set to at least one of the identified participants without presenting all of the n questions to all of the k participants and without presenting the same questions to each participant, gather responses from each participant to their respective question subsets presented for the research metric coincident with a navigation of the target website by a given participant, and combine the participants' responses to produce an index of the research metric; wherein the research module includes a setup engine operable to characterize the target website including determine a site profile and a task to be performed by a participant while navigating the target website; and a build tool operable to automatically select questions from a predefined list of questions directed to the research metric based on the site profile including selecting questions relevant to the task and present the one or more subsets of questions to a participant coincident with the navigation of the target website while performing the predetermined task. 18. The apparatus of claim 17 wherein the research data can be selected from usability, product and organizational research concerning the target website.19. The apparatus of claim 17 wherein the research module includes a question editor operable toform questions in a plurality of question sets that are a measure, respectively, of a plurality of research metrics to be gathered for the target website; and partition each question set into a plurality of subsets of questions. 20. The apparatus of claim 19 wherein the runtime engine is operable toonly present a subset of questions for each question set to each participant; gather responses from each participant to the questions presented for each research metric; and combine the participant's responses to produce a plurality of indexes, one for each of the research metrics. 21. The apparatus of claim 19 wherein the runtime engine is operable toonly present a subset of questions for one or more question sets to each participant; gather responses from each participant to the questions presented for each research metric coincident with the navigation of the target website by a given participant; and combine the participant's responses to produce a plurality of indexes, one for each of the research metrics. 22. The apparatus of claim 17 wherein the research module includes a pop up controller for producing and monitoring an effectivity of pop-up invitations based in part on responses received from participants presented a given pop-up invitation and a quota editor operable to determine a screening criteria for candidates based on user input and wherein the runtime engine includes a screening engine operable to screen participants to fine tune the research with respect to predefined benchmarks.23. The apparatus of claim 22 wherein the research module includescell editor operable to identify one or more participant types; a quota editor operable to set quotas for each participant type to be included in the research; and wherein the runtime engine includes a screening engine operable to screen participants based on the quotas for inclusion in the research. 24. The apparatus of claim 17 wherein the runtime engine includes a recorder controller operable to record participant responses when gathering participant research data as the participant navigates the target website while performing a predetermined task, the participant behavior information including screen capture information for screens presented to the user while performing the predetermined task.25. The apparatus of claim 24 wherein the participant responses are selected from the group of audio, gestural and keystroke responses captured as the participant navigates the target website.26. The apparatus of claim 24 where the recorder controller is operable to capture a screenshot of a user interface from the target website and presented to the participant during navigation of the target website and related to one or more of the participant responses.27. The apparatus of claim 24 wherein the runtime engine further includesa load engine operable to download a recorder to the website and upload behavioral responses gathered by the recorder during navigation of the target website by a given participant to a centralized research site for analysis; and wherein the recorder controller is operable to invoke the recorder when a participant is selected from whom responses are to be gathered. 28. The apparatus of claim 17 wherein the research module further includes a reward editor operable to incentivizing a candidate to become a participant including identifying a reward to be given to a participant upon completion of participation.29. The apparatus of claim 28 wherein the target website is a website of a competitor.30. The apparatus of claim 17 wherein the research module includes an invitation engine operable to identify participants including selecting from visitors at the target website including displaying an invitation to a selected visitor.31. The apparatus of claim 30 where the runtime engine further includes a pop-up palette controller operable toprovide a palette of invitations; gather statistical information each time an invitation is selected from the palette to measure one or more palette metrics; and select an invitation to be displayed to a selected visitor based on the statistics gathered for the one or more palette metrics. 32. The apparatus of claim 17 further including a collaboration module operable tostore historical results for the research metric and a representation of the target website or portion of the target website to which the metric pertains; invoke the gathering of new responses from participants to the questions presented at a predetermined time when the target website has been modified, where the runtime engine is operable to combine the participant's responses to produce an index of the research metric for the modified website; and compare the indexes for the website against the modified website to measure a change of the research metric between the two.