Telepractice and the BOT-2
The telepractice information in this document is intended to support practitioners in making informed, well-reasoned decisions around remote assessment. This information is not intended to be comprehensive regarding all considerations for assessment via telepractice. It should not be interpreted as a requirement or recommendation to conduct assessment via telepractice.
Practitioners should remain mindful to:
- Follow professional best practice recommendations and respective ethical codes.
- Follow telepractice regulations and legal requirements from federal, provincial and local authorities, licensing boards, professional liability insurance providers, and payors.
- Develop competence with assessment via telepractice through activities such as practicing, studying, consulting with other professionals, reviewing the available evidence, and engaging in professional development.
Practitioners should use their clinical judgment to determine if assessment via telepractice is appropriate for a particular examinee, referral question, and situation. There are circumstances where assessment via telepractice is not feasible and/or is contraindicated. Documentation of all considerations, procedures, and conclusions remains a professional responsibility.
Several professional organizations and experts have provided guidance on telepractice assessment (American Occupational Therapy Association [AOTA], 2020; American Psychological Association Services [APA Services], 2020; Association of State and Provincial Psychology Boards, 2013; Cason, et al., 2018; Grosch, et al., 2011; InterOrganizational Practice Committee, 2020; Stolwyk, et al., 2020) to assist practitioners in decision making and ethical and legal practice issues.
The Bruininks-Oseretsky Test of Motor Proficiency (2nd ed., BOT–2) must be administered by a qualified professional through observation and direct interaction with the examinee to follow standardized procedures.
Various options are available for administering the BOT–2 via telepractice based on the role of an on-site facilitator. However, it is important to consider the fact that the normative data were collected via face-to-face assessment. Telepractice is a deviation from the standardized administration, and the methods and approaches to administering it via telepractice should be supported by research and practice guidelines.
Without a facilitator and the standardized manipulatives in the BOT–2 kit at the location of the examinee, BOT–2 cannot be administered in a standardized format via telepractice. However, the clinician can interact with and observe the examinee via telepractice to obtain qualitative information on fine and gross motor skills (e.g., ability to manipulate small items, hopping on one foot). The clinician can review the BOT–2 items to identify relevant skills for structuring clinical observations. Even though items involving specific, standardized manipulatives cannot be administered remotely, the performance observations can still provide useful information using alternate materials. This approach, however, does not allow for the calculation of scores.
Providers engaging in telepractice assessment may train facilitators to work with them on a regular basis in order to provide greater coverage to underserved populations (e.g., only two providers within a 500-mile radius, shortage of evaluating practitioners within a school district). If such a facilitator is well trained and in a professional role (i.e., a professional facilitator, certified assistants), they can present test items and supervise for safety as well as adjust audiovisual equipment during a telepractice assessment. Given the use of numerous manipulatives during BOT–2 administration, the professional facilitator must have the BOT–2 kit and paper components readily available to use for standardized administration. This approach yields the BOT–2 subtest and composite scores that are available in face-to-face assessment mode. If a professional facilitator is not used, it impacts the workflow of the session, subtest selection, and the ability to reliably derive composite scores. Refer to The Use of Facilitators in Remote Test Administration for further information.
In times when social distancing is necessary, such as the COVID-19 pandemic, using a professional facilitator may not be safe or feasible. If testing must occur under these conditions, it may be possible that the examinee participates with the help of a nonprofessional on-site facilitator in the examinee’s home or other location (e.g., a parent, guardian, caretaker). These on-site facilitators can assist with technological and administrative tasks during testing (e.g., providing pages of the examinee booklet) but will require orientation to these responsibilities before the session. If using an on-site facilitator who is not in a professional role, the examiner should use their professional judgment about the capacity of the facilitator to perform the required functions correctly, safely, and without interfering in the testing session.
An initial virtual meeting with the designated on-site facilitator should occur in advance of the testing session to address numerous issues specific to testing via telepractice. This initial virtual meeting is described in the administrative and technological tasks portion of the Examiner Considerations section and referred to in various sections of this document. After this initial meeting, the examiner should consider if remote administration is possible and appropriate before proceeding.
For BOT–2, facilitators should remain in the room with the examinee throughout the testing session to monitor and address the examinee’s practical needs, as well as any technological or administrative issues as necessary. The facilitator’s role should be defined clearly by the examiner in advance of the testing session. The facilitator should only perform those functions the examiner deems necessary and instructs the facilitator to complete.
With a well-trained facilitator in a professional role (i.e., professional facilitator, certified assistant), subtests from the BOT–2 could successfully be administered with a remote examiner and all subtest and composite scores could be derived. When using a nonprofessional facilitator (e.g., parent), the examiner will have to determine in any of the subtests that do not require standardized manipulatives (i.e., Fine Motor Precision, Fine Motor Integration, and Bilateral Coordination) are possible and appropriate given the evaluation conditions. If any subtests are deemed to be inappropriate for remote administration even with use of a facilitator, then you will not be able to obtain some composite scores.
Conclusion
The BOT–2 was not standardized in a telepractice mode, and this should be taken into consideration when utilizing this test via telepractice and interpreting results. For example, the examiner should consider relying on a convergence of multiple data sources and/or be tentative about conclusions. Provided that the examiner has thoroughly considered and addressed the factors and the specific considerations as listed above, the examiner should be prepared to observe and comment about the reliable and valid delivery of the test via telepractice. Materials may be used via telepractice without additional permission from Pearson in the following published contexts:
- BOT–2 Manuals and digital Stimulus Book via Q-global
Any other use of the BOT–2 via telepractice is not currently recommended. This includes, but is not limited to, administering the assessment without a facilitator, scanning the paper Administration Easel, digitizing the paper Record Forms, physically holding the Administration Easel up in the camera’s viewing area, or uploading a Manual onto a shared drive or site.
References
American Occupational Therapy Association (AOTA). (2020). Telehealth Resources. https://www.aota.org/Practice/Manage/telehealth.aspx
American Psychological Association Services (APA Services). (2020). Guidance on psychological tele-assessment during the COVID-19 crisis. (2020). https://www.apaservices.org/practice/reimbursement/health-codes/testing/tele-assessment-covid-19?fbclid=IwAR1d_YNXYS2Yc5mdIz_ZIYSkrrJ_6A9BQeKuIHxEEjjRh1XDR6fOYncM3b4
Association of State and Provincial Psychology Boards (ASPPB). (2013). ASPPB telepsychology task force principles and standards. https://cdn.ymaws.com/www.asppb.net/resource/resmgr/PSYPACT_Docs/ASPPB_TELEPSYCH_PRINCIPLES.pdf
Cason J., Hartmann, K., & Richmond, T. (2018). Telehealth in occupational therapy. The AmericanJournal of Occupational Therapy, 72, 1-18. https://doi.org/10.5014/ajot.2018.72S219
Eichstadt, T. J., Castilleja, N., Jakubowitz, M., & Wallace, A. (2013, November). Standardized assessment via telepractice: Qualitative review and survey data [Paper presentation]. Annual meeting of the American-Speech-Language-Hearing Association, Chicago, IL, United States.
Interorganizational Practice Committee [IOPC]. (2020). Recommendations/guidance for teleneuropsychology (TeleNP) in response to the COVID-19 pandemic. https://static1.squarespace.com/static/50a3e393e4b07025e1a4f0d0/t/5e8260be9a64587cfd3a9832/1585602750557/Recommendations-Guidance+for+Teleneuropsychology-COVID-19-4.pdf
Stolwyk, R., Hammers, D. B., Harder, L., & Cullum, C. M. (2020). Teleneuropsychology (TeleNP) in response to COVID-19. https://event.webinarjam.com/replay/13/pyl2nayhvspsp09
Telepractice–Face-to-Face Mode
See Table 1
- Abdolahi, A., Bull, M. T., Darwin, K. C., Venkataraman, V., Grana, M. J., Dorsey, E. R., & Biglan, K. M. (2016). A feasibility study of conducting the Montreal Cognitive Assessment remotely in individuals with movement disorders. Health Informatics Journal, 22(2), 304-311. https://doi.org/10.1177/1460458214556373
- Dorsey, E. R., Deuel, L. M., Voss, T. S., Finnigan, K., George, B. P., Eason, S., ... & Viti, L. (2010). Increasing access to specialty care: A pilot, randomized controlled trial of telemedicine for Parkinson's disease. Movement Disorders, 25(11), 1652-1659. https://movementdisorders.onlinelibrary.wiley.com/doi/abs/10.1002/mds.23145
- Galusha-Glasscock, J., Horton, D., Weiner, M., & Cullum, C. M. (2016). Video teleconference administration of the Repeatable Battery for the Assessment of Neuropsychological Status. Archives of Clinical Neuropsychology, 31(1), 8–11.
- Grosch, M., Weiner, M., Hynan, L., Shore, J., & Cullum, C. M. (2015). Video teleconference-based neurocognitive screening in geropsychiatry. Psychiatry Research, 225(3), 734–735.
- Hoffmann, T., Russell, T., Thompson, L., Vincent, A., & Nelson, M. (2008). Using the Internet to assess activities of daily living and hand function in people with Parkinson's disease. NeuroRehabilitation, 23(3), 253-261. https://doi.org/10.1177/1357633X16634258
- Hwang, R., Mandrusiak, A., Morris, N. R., Peters, R., Korczyk, D., & Russell, T. (2016). Assessing functional
exercise capacity using telehealth: Is it valid and reliable in patients with chronic heart failure. Journal of
Telemedicine and Telecare, 23, 225–232. https://doi.org/10.1177/1357633X16634258 - Palsbo, S. E., Dawson, S. J., Savard, L., Goldstein, M., & Heuser, A. (2007). Televideo assessment using Functional Reach Test and European Stroke Scale. Journal of Rehabilitation Research & Development, 44(5).
- Temple, V., Drummond, C., Valiquette, S., & Jozsvai, E. (2010). A comparison of intellectual assessments over video conferencing and in-person for individuals with ID: Preliminary data. Journal of Intellectual Disability Research, 54(6), 573–577. https://doi.org/10.1111/j.1365-2788.2010.01282.x
- Wright, A. J. (2020). Equivalence of remote, digital administration and traditional, in-person administration of the Wechsler Intelligence Scale for Children, Fifth Edition (WISC-V). Psychological Assessment. Advance online publication. http://dx.doi.org/10.1037/pas0000939
Digital–Traditional Format
See Table 2
- Daniel, M. H. (2012). Equivalence of Q-interactive administered cognitive tasks: WISC–IV (Q-interactive Technical Report 2). Pearson. https://www.pearsonassessments.com/content/dam/school/global/clinical/us/assets/q-interactive/009-s-Technical%20Report%202_WISC-IV_Final.pdf
- Daniel, M. H., Wahlstrom, D., & Zhang, O. (2014). Equivalence of Q-interactive and paper administrations of cognitive tasks: WISC®–V (Q-interactive Technical Report 8). Pearson. https://www.pearsonassessments.com/content/dam/school/global/clinical/us/assets/q-interactive/003-s-Technical-Report_WISC-V_092514.pdf
- Raiford, S. E., Holdnack, J. A., Drozdick, L. W., & Zhang, O. (2014). Q-interactive special group studies: The WISC–V and children with intellectual giftedness and intellectual disability (Q-interactive Technical Report 9). Pearson. Retrieved from http://www.helloq.com/content/dam/ped/ani/us/helloq/media/Technical_Report_9_WISC-V_Children_with_Intellectual_Giftedness_and_Intellectual_Disability.pdf
- Raiford, S. E., Drozdick, L. W., & Zhang, O. (2015). Q-interactive special group studies: The WISC–V and children with autism spectrum disorder and accompanying language impairment or attention-deficit/hyperactivity disorder (Q-interactive Technical Report 11). Pearson. http://images.pearsonclinical.com/images/assets/WISC-V/Q-i-TR11_WISC-V_ADHDAUTL_FNL.pdf
- Raiford, S. E., Drozdick, L. W., & Zhang, O. (2016). Q-interactive special group studies: The WISC–V and children with specific learning disorders in reading or mathematics (Q-interactive Technical Report 13). Pearson. https://www.pearsonassessments.com/content/dam/school/global/clinical/us/assets/q-interactive/012-s-Technical_Report_9_WISC-V_Children_with_Intellectual_Giftedness_and_Intellectual_Disability.pdf
- Raiford, S. E., Zhang, O., Drozdick, L. W., Getz, K., Wahlstrom, D., Gabel, A., Holdnack, J. A., & Daniel, M. (2015). Coding and Symbol Search in digital format: Reliability, validity, special group studies, and interpretation (Q-interactive Technical Report 12). Pearson. https://www.pearsonassessments.com/content/dam/school/global/clinical/us/assets/q-interactive/002-Qi-Processing-Speed-Tech-Report_FNL2.pdf