Will anything be due to RTI for the current year's evaluation (there was an online survey in past years) or just the Annual Report?

The only items that should be sent to RTI directly for this year’s evaluation are the completed individual strategy pre- and post-surveys. However, all providers are still required to submit all other evaluation instruments and reports (e.g. End of Year Reports) as required by DBHDD and your RPS.

ASAPP Evaluation

Will RTI match case IDs for individual pre- and post-surveys in the Excel file sent to providers?

As RTI is only analyzing aggregated data at the cross-site level, pre- and post-surveys will only be matched at the provider level. Each provider will receive a full sequence of case IDs for both the pre- and post-surveys. If providers track which participant completes which case ID identified surveys, they will be able to match and analyze matched surveys at the individual level. RTI will not monitor any possible individual matching of survey participants.

Please note that the matching process poses additional risks to the confidentiality of the student data and may require additional Institutional Review Board approval or other research approval from your organization, your evaluator’s organization (e.g. a university), or the organization where you collect data (e.g., a school system).

ASAPP Evaluation

Our intervention addresses prescription drugs and marijuana in addition to alcohol. Will the individual surveys be able to capture the information about these other substances? Will we be able to substitute the substance that we want to measure?

Yes. There are questions related to prescription drug misuse and marijuana use on the High School version and the Parent version of the individual survey. There is no question related to prescription drugs on the Middle School version. It is not possible to substitute prescription drugs with another substance of choice, as the surveys are already standardized, formatted, and programmed.

ASAPP Evaluation

Is there an e-cigarette question on all individual surveys? Providers request these on both youth and the parent version, as it is important to assess whether parents are modeling e-cigarette behaviors.

No. There is a question that includes e-cigarettes on the Middle School and the High School versions of the individual strategy survey. There is no question regarding e-cigarettes on the Parent version of the survey.

ASAPP Evaluation

At the end of the year, will RTI be able to provide analyzed or raw data to the providers?

RTI will only analyze data in aggregate at the cross-site level, and cannot analyze data for individual providers. Raw data from the Georgia ASAPP Individual Strategy Surveys will be returned to providers in the form of an Excel file on a quarterly basis.

ASAPP Evaluation

The surveys presented are all specific for individual level strategies. Will there be a survey for environmental level strategies? How are environmental strategy surveys to be handled? Should providers send them to the evaluation team before using them? Will you offer any TA around evaluating positive social norms (PSN) campaigns?

We understand that some providers may want to implement their own environmental strategy surveys to assess community-level outcomes. RTI has not developed a survey for environmental strategies at this time. However, we can provide some technical assistance if you wish to develop your own. We may be able to 1) provide some guidance on implementing your environmental strategy surveys, 2) develop a general item bank from which providers can select items to develop their own surveys, or 3) provide assistance in developing a standardized, scannable survey form that can be administered by providers who wish to administer environmental strategy surveys. Please complete a TA request via ECCO if you would like assistance developing an environmental strategy survey.

ASAPP Evaluation

My individual strategy comes with pre- and post-surveys. Are we to disregard these surveys and just use those provided by RTI?

You must use the pre- and post-surveys developed by RTI, as they are required for the cross-site evaluation. You may also use the surveys obtained as part of your individual strategy, but they should only be used for your own evaluation of your program. The data from these surveys will not be analyzed by RTI.

ASAPP Evaluation

Our program serves some elementary school children. What survey should they use?

We do not recommend using the current surveys for youth under 10 years old. If your sample consists of both youth under the age of 10 and youth 10 and older, you should administer the survey attached to the curriculum for the youth under 10 years old and the “GA ASAPP State Evaluation: Individual Strategy Survey” Middle school version to the youth 10 and older.

If there is no other survey available (e.g. one associated with the chosen curriculum), and the entire sample consists of youth under the age of 10, do not administer the Middle School version of the survey. Please send a TA request via ECCO if you work with youth under 10 so that we can develop an appropriate evaluation plan.

ASAPP Evaluation

Will there be an electronic version of the individual surveys?

Yes. RTI developed an online version of the individual strategy surveys using REDCap. Information on how to access the online versions of the surveys is outlined in the Data Collection & Submission Procedures document.

ASAPP Evaluation

How long will it take to receive paper surveys after they are requested?

Once a Survey Request Form is received, expect to receive the paper surveys in the mail within 15 business days. Providers are advised to request paper surveys at least 3 weeks before they are needed. This information is outlined in the Data Collection & Submission Procedures document.

ASAPP Evaluation

How do I request individual survey forms?

All providers have received the Georgia ASAPP Individual Strategy Survey Request Form. In addition, it is available at: http://resources.ga-sps.org (see under “evaluation”). Providers should complete the form and send it as a TA request via ECCO.

Providers also received detailed instructions for requesting and submitting completed surveys in the Georgia ASAPP Evaluation: Data Collection & Submission Procedures document which is also available at: http://resources.ga-sps.org (see under “evaluation”).

ASAPP Evaluation

I ran out of surveys. Can I just copy my last blank one to hand out?

NO. Each survey has two ID numbers on it that are necessary for processing and analysis. One ID is unique to each provider, which will be used for pairing each pre- and post-survey to that provider. The other is a unique case ID unique that is specific to each completed survey. No two surveys will have the same case ID printed on them. Therefore, providers should not photocopy the surveys. Please make sure to request additional surveys BEFORE you run out.

ASAPP Evaluation

How long is the individual strategy survey?

There are three versions of individual surveys. The Middle School version of the survey contains 18 questions; the High School version has 20 questions; and the Parent version has 21 questions.

ASAPP Evaluation

Will the slides from the “Office Hour” sessions be available for download?

Yes. We will make sure the slides are available to OBHP (including all the information we are presenting at the regional provider meetings). Your RPS will let you know where to find those.

ASAPP Evaluation

If a Provider cannot spend all of his/her funds for FY2017, can they be carried over into next year? If not, what are some suggestions for spending down the available funds?

No funds cannot be carried over to another contract year. Please speak individually with your RPS concerning funding.

Contracts

Does attending the SAPST training in Macon count as the required conference within the contract for FY2017

Yes, this training will for the FY17 contract year.

ASAPP

Will future regional meetings have the option for web capability if a Provider is unable to attend in-person?

We can accommodate with a conference line. However, providers are welcome to use their own technology to web conference with staff at their agencies who are unable to attend the meeting.

ASAPP

What types of questions should be entered into ECCO for technical assistance versus what types of questions should be directed towards the Regional Prevention Specialist (RPS)

The questions entered in ECCO should be questions concerning the strategies, process, implementation of the project. Any programmatic, invoice related or budget questions should be directed to your RPS.

Using ECCO