Experiential knowledge shows that preparation for remote monitoring and evaluation in terms of developing sampling frames, sample selection, ensuring training of data enumerators, and fine-tuning data collection tools and applications are critical in ensuring successful remote interviews. However, these activities include several sub-activities and take lots of detailed discussions and planning, including revisits, re-strategizing, critical reflection, regular debriefings and feedback, and continuously improving the process of data collection. For example, while undertaking sampling for a nationwide survey of respondents exposed to radio and television programs, the sample was distributed based on the proportion of the population. 

The sampling was conducted region-wise, province-wise, gender-wise and by educational attainment. Through discussions with the client, it was agreed that respondents who spent considerable years in Madrasa education should be treated as being educated. Additionally, the sample was to be aligned as much as possible with the country-level data on education as provided by the client. All this was done to make the sample as representative as possible. Nevertheless, this increased the challenge of reaching the respondents who fitted into the required sampling frame. Further, an eligible respondent was one who had previous exposure to relevant program content on radio, television, or social media. 

A screening questionnaire was used to recruit eligible respondents using a database received from the client and the proprietary database of AACS Consulting. However, the database shared by the client was provided to them by another research agency from a previous research assignment and most of the phone numbers were not relevant to the survey. In order to increase the numbers, which could have a higher possibility of fitting into the inclusion criteria for the survey, exponential non-discriminative snowball sampling was used. One of the major challenges was ensuring women’s representation in the sample. To address this challenge, snowball sampling proved to be effective. To ensure transparency and accountability in remote monitoring and evaluation, the client was provided with daily reports which included data about screening and final successful interviews completed. 

The client also kept a keen eye on the data quality as the data was collected through the KoBo application and the KoBo database was a shared one between the client and AACS Consulting. Talking about the KoBo application was developed by the client but was fine-tuned by AACS Consulting. In order to fine-tune the application (both screening and main questionnaire), the application was subjected to a dry run of 10 samples and then 100 samples. Findings from the dry run were used to fine-tune the application to make the interviewing process more efficient (less time-consuming). However, this exercise proved helpful in training the enumerators as they experienced real-life situations while undertaking the pilot interviews. In order to reduce dropouts, screening and main interviews were conducted simultaneously. Further, more female enumerators were recruited as experiential knowledge shows that respondents are keener to talk to a female enumerator. Female enumerators also have higher interview completion rates than male enumerators during remote monitoring and evaluation.