AI-TOP External Evaluation - Partners Consultation (Month 18)
AI-TOP External Evaluation – Information and Consent
Please, read the following data management and protection policy and provide your explicit consent before moving to the survey content:
Thank you for choosing to allocate your time to participate in this External Evaluation survey, which is undertaken in the framework of the AI-TOP project and in the interest of the project's partnership.
The purpose of the survey is the: i) Evaluation of project outputs against information in project’s contract and any documents produced and agreed by the consortium thereafter; ii) Evaluation of the dissemination/impact of the project outputs against KPIs in the project’s contract and any relevant information produced and agreed upon by the consortium thereafter; iii) Evaluation with focus on project outputs and their innovation, effectiveness, usability, accessibility and overall uptake level by stakeholders target groups; iv) Production of the the external evaluation reports to be submitted to the project consortium.
Participation is mandatory for one person per partner organisation. Your responses are confidential and will only be used for the purposes of the survey. You will be informed of the results of this survey through a dedicated presentation at one of the subsequent project transnational meetings.
For your participation in this survey you will be asked to give some data and information, which will be processed in accordance with the general Data Management and Protection Policy of the data processor, which you can find here. Please, pay particular attention to your rights in relation with your personal data. Acting in the framework of our general policy, we provide the following specific information with regards to the collection and processing of data for the present study:
Please, note: the above-mentioned data will be kept ONLY during and within the AI-TOP project contract. After the end of the contract and a subsequent period of 6 months, all data that link your responses to your identity, will be deleted and the survey content will undergo a fully pseudonymized processing. In other words, no human or the system collecting data, will be able to identify the individual that provided the responses. The pseudonymized data will be kept for a period of 5 years for the needs of the project and the funding agency.
Consent: *
| Yes | No | |
|---|---|---|
| I provide my explicit consent for my participation in the aforementioned external evaluation survey and for the subsequent processing of the data and information I provide, as above described: |
Part I - Project Internal Process
1. Project objectives and workplan (please, indicate the extent to which you agree with the statements below): *
| Not at all | Not really | Agree | Absolutely agree | |
|---|---|---|---|---|
| We did not have issues with understanding and implementing the project action plan | ||||
| We did not face issues with the timely delivery of our assigned activities/tasks. | ||||
| We delivered our assigned activities/tasks at the expected quality. |
Please, share any comment you consider useful to support your responses:
2. Partnership communication (please, indicate the extent to which you agree with the statements below): *
| Not at all | Not really | Agree | Absolutely agree | |
|---|---|---|---|---|
| The communication among project partners has been easy and fruitful. | ||||
| The communication and collaboration at project meetings (offline or online) or other bilateral meetings has been effective. | ||||
| The interaction with partners in the production of joint tasks/outputs has been successful. | ||||
| The use of the online tools for data storage and exchange of information has been effective. |
Please, share any comments you consider useful, to support your responses:
3. Activity and financial coordination (please, indicate the extent to which you agree with the statements below): *
| Not at all | Not really | Agree | Absolutely agree | |
|---|---|---|---|---|
| The communication with the coordinating team has been easy and effective | ||||
| The communication and collaboration with other activity leaders have been effective | ||||
| We received all required support regarding the workplan analysis and definition of expectations | ||||
| We received all required support regarding financial issues and reporting |
Please, share any comment you consider useful, to support your responses:
Part II - Project Outputs
4. O1 Status (Please, state your view about the completion status of the Output) *
| Not startet yet | Ongoing - early stage | Ongoing - medium progress | Ongoing - mature results | Delivered | Under revision/refinement | In pilot use with stakeholders | In production use | |
|---|---|---|---|---|---|---|---|---|
| T1.1: Research all materials regarding autism engagement and 'meltdown', including the pre-'rumble' stage | ||||||||
| T1.2: Database Requirements (what data to collect, how the data relate to each other, what to do with the data) | ||||||||
| T1.3: Implementation of Database embedded into website Wordpress plugin | ||||||||
| T1.4: Final changes to Database based on Piloting activities |
Please, explain your responses as you deem necessary:
5. O2 Status (Please, state your view about the completion status of the Output) *
| Not startet yet | Ongoing - early stage | Ongoing - medium progress | Ongoing - mature results | Delivered | Under revision/refinement | In pilot use with stakeholders | In production use | |
|---|---|---|---|---|---|---|---|---|
| T2.1: Adjusting Games to label engagement acting as ’Continuous Performance Tests’ (outcomes of the games, such as errors and reaction time, are used to label sensor data, to then train the AI-driven algorithms) | ||||||||
| T2.2: Observational Behavioural Checklists to label Arousal – expert observers will use a validated arousal behaviour scale to collect data from students with ASC in normal and aroused states ('rumble' and 'meltdown' events) | ||||||||
| T2.3: Fine-tuning of the core AI "engine" for inference of engagement and to predict ‘meltdown’ events, thus delivering an optimised algorithm | ||||||||
| T2.4: Implementation of the Teacher/Parent facing Dashboard (Traffic Lights/Graph-over-Time), including co-design sessions with teachers and students with autism. |
Please, explain your answers as you deem necessary:
6. O3 Status (Please, state your view about the completion status of the Output) *
| Not startet yet | Ongoing - early stage | Ongoing - medium progress | Ongoing - mature results | Delivered | Under revision/refinement | In pilot use with stakeholders | In production use | |
|---|---|---|---|---|---|---|---|---|
| T3.1 - Identification of piloters | ||||||||
| T3.2 - Recruitment of piloters | ||||||||
| T3.3 - Piloting and testing | ||||||||
| T3.4 - Extraction of proven best practical and pedagogical impact | ||||||||
| T3.5 - Collecting feedback, and subsequently revise and finalise the outomes | ||||||||
| M1 Piloting (30 users/teachers per country) in UK, BE, BG, GR and SBR | ||||||||
| M2 Impact and best practices report |
Please, explain your answers as you deem necessary:
7. O4 Status (Please, state your view about the completion status of the Output) *
| Not startet yet | Ongoing - early stage | Ongoing - medium progress | Ongoing - mature results | Delivered | Under revision/refinement | In pilot use with stakeholders | In production use | |
|---|---|---|---|---|---|---|---|---|
| T4.1 Outline of handbook | ||||||||
| T4.2 Partnership review of outline with feedback | ||||||||
| T4.3 Final version of handbook incorporating feedback from piloting | ||||||||
| M1 Finalised handbook |
Please, explain your answers as you deem necessary:
8. O5 Status (Please, state your view about the completion status of the Output) *
| Not startet yet | Ongoing - early stage | Ongoing - medium progress | Ongoing - mature results | Delivered | Under revision/refinement | In pilot use with stakeholders | In production use | |
|---|---|---|---|---|---|---|---|---|
| T5.1 Develop appropriate questions for each dimension (Educational, Social, Organisational & Technological) within a dedicated workshop at the second partner meeting | ||||||||
| T5.2 Focus groups in each country with School Staff and Parents/Carers to collect responses to questions in each dimension | ||||||||
| T5.3 Develop 'Directives' to form a blueprint for the optimal adoption of AI-driven technology in schools to support personalisation in learning and improved mental wellbeing of students with ASC. | ||||||||
| T5.4 Final version of the Framework based on piloting feedback. |
Please, explain your responses as you deem necessary:
9. Understanding of outputs and contributions (please, indicate the extent to which you agree with the statements below): *
| Not at all | Not really | Agree | Absolutely agree | |
|---|---|---|---|---|
| We are fully aware about the produced project outputs | ||||
| We are clear about what our contribution was/should-be to each one of the outputs |
Please, share any comment you consider useful, to support your responses:
10. Innovation confirmed by partners, stakeholders and the literature (please, rate the innovation level of each project output below): *
| Low | Medium | High | Very high | |
|---|---|---|---|---|
| O1: Online Searchable Database | ||||
| O2: Transferred Mobile Engagement and Meltdown Measurement App | ||||
| O3: Optimisation of Autism Engagement and Meltdown framework | ||||
| O4: Handbook for Teachers and Parents | ||||
| O5: Pedagogical Framework for Students with Autism |
Please, share any comment you consider useful, to support your responses:
11. Effectiveness confirmed by partners and stakeholders (please, rate the effectiveness level of each project output below): *
| Low | Medium | High | Very high | |
|---|---|---|---|---|
| O1: Online Searchable Database | ||||
| O2: Transferred Mobile Engagement and Meltdown Measurement App | ||||
| O3: Optimisation of Autism Engagement and Meltdown framework | ||||
| O4: Handbook for Teachers and Parents | ||||
| O5: Pedagogical Framework for Students with Autism |
Please, share any comment you consider useful, to support your responses:
12. Usability confirmed by partners and stakeholders (please, rate the usability level of each project output below): *
| Low | Medium | High | Very high | |
|---|---|---|---|---|
| O1: Online Searchable Database | ||||
| O2: Transferred Mobile Engagement and Meltdown Measurement App | ||||
| O3: Optimisation of Autism Engagement and Meltdown framework | ||||
| O4: Handbook for Teachers and Parents | ||||
| O5: Pedagogical Framework for Students with Autism |
Please, share any comment you consider useful, to support your responses:
13. Accessibility confirmed by partners and stakeholders (please, rate the accessibility level of each project output below): *
| Low | Medium | High | Very high | |
|---|---|---|---|---|
| O1: Online Searchable Database | ||||
| O2: Transferred Mobile Engagement and Meltdown Measurement App | ||||
| O3: Optimisation of Autism Engagement and Meltdown framework | ||||
| O4: Handbook for Teachers and Parents | ||||
| O5: Pedagogical Framework for Students with Autism |
Please, share any comment you consider useful, to support your responses:
14. Dissemination (please, indicate the extent to which you agree with the statements below): *
| Not at all | Not really | Agree | Absolutely agree | |
|---|---|---|---|---|
| We are aware of the dissemination tools created in the project | ||||
| We have contributed to the creation of the dissemination tools | ||||
| We have used certain dissemination tools effectively | ||||
| We undertook dissemination activities according to the plan | ||||
| We managed to disseminate project outputs successfully to users and stakeholders in our local community |
Please, share any comment you consider useful, to support your responses:
Part III - Outputs Sustainability and Impact
15. Sustainability and Impact (please, indicate the extent to which you agree with the statements below): *
| Not at all | Not really | Agree | Absolutely agree | |
|---|---|---|---|---|
| Users/stakeholders in our country are fully aware of the project outputs | ||||
| Users/stakeholders in our country understand how to use the outputs in their everyday work | ||||
| Users/stakeholders in our country confirm their motivation to use the outputs | ||||
| Users see an added value to their work by using the outputs | ||||
| Users/stakeholders have already committed in using certain part of the project outputs | ||||
| We already have a clear plan on how to exploit and sustain our contributions | ||||
| We already have a clear plan on how to continue collaboration with other partners to exploit the products as a whole | ||||
| The investment seems to be worth it and we expect to break even within planned time-frame. |
Please, share any comment you consider useful, to support your responses: