Appendix C
blackboard > about blackboard > fall 2000 faculty survey > appendix c
Proposed Evaluation Instrument
Created by the Faculty Sub-Group of the E-University Steering Committee
- Functionality Issues
- What features in Blackboard are you using and why?
- What features in Blackboard are you not using, and why not?
- What features in Blackboard did not work well for you?
- Were you prevented from doing something with Blackboard you wanted to do?
- What additional capabilities would you like Blackboard to have?
- Overall, does Blackboard meet your expectations?
- Impact on Instruction: Based on your experience with Blackboard over the past semester (i.e., rather than speculating what could or should have happened):
- What impact has this application had on your instruction?
- What impact has this application had on student/faculty interactions?
- What impact has this application had on student/student interactions?
- What impact has this application had on faculty/faculty interactions?
- Did you take (or would you take) steps to assess the differences between using and not using Blackboard? If so, what assessment(s) did you make. If not (in retrospect) what assessment(s) would you have made.
- What were your instructional goals for using this application?
- Where was the application effective and where did it fail to meet your effectiveness expectations?
- What feedback did you get from the students?
- How would you characterize the time associated with faculty learning curve? The student learning curve? If this learning curve took away instructional time, was it worth the trade off?
- Usability Issues
- 1. How would you rate the ease of use of this package?
- 2. How would you characterize the faculty learning curve in terms of usability? The student learning curve?
- 3. Did you feel that the navigation with Blackboard was clear, consistent, and easy to understand. Were you able to locate components and tools you needed quickly and easily?
- 4. Were the buttons and other elements associated with blackboard labeled clearly and accurately. When you selected a button, link, etc., did you get the expected result?
- Were screens for entering and editing data well designed & easy to use.
- In terms of usability, do you have comments on from a faculty perspective or from a student perspective on:
- access to computers to use Blackboard.
- your ability to access (logon) to Blackboard.
- Blackboard's performance in terms of speed, breakdown, etc.
- Did you find it easy/possible to report problems that arose? Were you satisfied with the response or resolution to the problem(s)
- Were the search functions useful and did they function as expected?
- IV. Accessibility/li>
- Were there (to the best of your knowledge) any students with disabilities in your class using Blackboard? If so, did they encounter any disability-related difficulties using the system?
- Were there any faculty issues relating to
- V. Implementation
- There are three possibilities for establishing course web sites automatically using Blackboard. Which of the following do you believe should be the standard implementation for the campus (Note: This does not mean to imply that Blackboard will be the only package available on campus. We anticipate that faculty will continue to be able to create their own web sites for their courses using their preferred tool(s).
- Every course on campus has a course website automatically generated by Blackboard and the faculty member cannot turn it off.
- Every course on campus has a course website automatically generated by Blackboard, but the faculty member can turn if off if they so desire.
- Blackboard course websites are generated only if the faculty member requests it be done (or, if it is more efficient to create Blackboard sites for all courses, the course website would only be 'activated' upon the faculty members request).
- What should the University policy be concerning mandatory websites for classes (open ended question).
- Would you like to raise any additional student-related issues (from a faculty perspective) that were not covered in this survey?
- VII. Would you like to raise any additional faculty-related issues that were not covered in this survey?
[Note: We anticipate that the issue of what should be globally on/off and what features under individual faculty on/off control may be clearer from these responses].
[Note: It might be good to approach questions 3 & 4 by constructing a table of buttons, elements, links, etc. from screenshots or menus to ask these questions]





