Question Pools seem fairly straightforward at first glance, but please tell us about how/if you use question pools and if there are ways that this feature may be improved for the Ultra experience.
Hey Megan Truett and Brad Evans! I'm showing off these great features, but I can't vote, how do I go about doing that? Thanks!
We'll be turning on voting in the coming weeks, but we aren't quite ready for it yet. I'd like to start with discussions and grow the membership numbers first, and then go through a couple priority voting exercises.
We use question pools in Angel now to share across the entire district and targeted schools. We load ExamView and other question sets into pools and share them. Only item we had issue with is updating a Pooled question, and how it then updates assessments that linked to that question from the pool.
I encourage my faculty to create pools prior to building exams. I tell them to organize pools around chapters, topics, units...whatever breakdown of their content makes the most sense. And then they can use the pools to create question sets on the exams - tell Bb how many questions to include and how many from each set the students have to answer.
We do not have a test proctoring service, so using pools as test banks and creating the question sets is one way to help minimize cheating.
I always suggest using pools for creating questions especially if you may use the same question on different quiz, test or exams. Having them in a pool makes it easier for them to create question sets and/or random block tests. You can even use pool questions for surveys and share them with other instructors.
We always suggest for pools to be created and using the questions from pools to create tests. One of the most important features that can be added is noting what pool each question comes from. Often professors will create an exam/quiz, change the chapters included, and then want to change questions. Being able to quickly identify the questions origin is very important. Thank you.
One of the features I hear from faculty regarding pools is that they want to create one, but all of the questions refer to a specific text, image, diagram, etc. Right now they have to put that same information in all of their questions or, make one question static with all of that information, then place the pool. If a pool could have a "common content" area, like the description in an item, which displayed for all questions, that would be nice.
To add to that, it would be helpful to be able to mark those as a set of questions that can be included in a random block without altering the membership or order of the set of questions. For example, if 3 questions are asked about the same image or diagram, that set of 3 questions is always pulled into a random block together. This would be particularly helpful for being able to use random blocks to ask more advanced questions about a single sample of content.
When building a test using question sets (from pools), each one displays as "Question Set". If there was a way to change that title, it would be easier to identify which questions are coming from which pool.
Also miss being able to add "parts" to a question (from the Vista days...)
I realize I'm just dreaming here, but... I'd really like to be able to drag-and-drop questions from pools into tests, like putting songs into a playlist. And while I'm dreaming, let me drag multiple questions from pools, and have those add as question blocks.
Oh, and let me store pools in my user Content Collection, instead of within a specific course.
Totally agree, we have questions that we want all teachers in the district to be able to access but stay within the district.
Yes drag and drop would be great. And being able to have a master list for Pools so that you don't have to edit the same question repeatedly in multiple courses.
The current interface for selecting questions is very clunky. (9.1) Lots of scrolling up and down if you have a lot of questions that you want added to the question set. You have to scroll down to either 'Show All' or edit the number displayed on the page, then scroll up to select all on page one. Add them to the assessment, go back to add more questions, go to page 2, etc. Instructors hate this.
@David Gray: if pools could be stored outside a course/organisation context, they would become a LOT more useful than they are now.
not entirely (un)related - ideas for new ideas in this community:
- genuine inline quizes for self-tests and informal evaluation, as it is now, every Bb test is displayed as a formal exam...
- adaptive paths within a test
Thank you for the feedback, Bert. We're very close to opening up Idea submission to everyone, should be in the next week or so. The two ideas you posted here are great and I'm looking forward to hearing what the rest of the community thinks about them. If we don't get Idea submission opened up as soon as I'm expecting, I'll come back and enter these for you.
This would be very, very helpful! We are now forced to use other systems (like Questionmark), but if only this feature was added you would probably already outperform them!
It is Laviece Ward at Wake Technical Community College in Raleigh NC. I am experimenting in using a set of tests that have been offered to me via WW Norton. This test pool came as a part of the adoption of a Norton text book They Say/I Say for English 112. The tests are grammar, writing, punctuation, and other things like that. It was a bit of a hassle to get them to download into BB, but I worked with Norton and our IT Dept. at WTCC, and got it done.
I am deploying a 10 question test each week (sentence construction, paragraph design, citing quotations, etc.) on a "brush up your skills" basis, for my students. I am interested to see how this process will work with my students.
Dr. Ward (Avatar)
One thing that seems to be missing in pools is the connection with the question metadata and then how the questions are imported into tests.
We'd like to be able to assign meta-data to questions and be able to use that to filter the pools.
For instance, we may have a pool on a specific topic but then have question difficulties assigned to the questions in the pool.
What we'd like to be able to do is to create multiple random blocks (or question sets) from one pool based on the metadata tag such as difficulty.
eg. first set of '10' questions from 'PoolA' with difficulty of 'easy'. Second set of '5' questions from 'PoolA' with difficulty of 'hard'. Third set of '10' questions from PoolB with difficulty of 'easy' etc.
When creating a question set from a pool, it would be cool if the set could include a description displayed to the students... eg. "The next five questions will test your....".
Though this is not specific to pools a couple of things that are always asked for are:
The other thing I forgot is the ability for question pools to be attached to a hierarchy node rather than just a specific course. There are a couple of reasons for this...
1. a subject from one semester to the next wants to build on the existing pool and reuse questions. However, some disciplines have very strict rules about the re-use of questions (eg. cannot re-use for two years after last use in that course). If a pool was attached to a node then it should be relatively easy to display information about where a question has been used (deployed) and how long ago.
2. This would be useful for revision across courses. Often courses will follow-on from each other in a program or degree so it is often useful to have the students refresh their knowledge in later courses.
3. Question performance could be monitored across multiple courses and terms rather than just in a single cohort.
I have a question that hopefully I didn't overlook the answer to as I skimmed through this thread. We too advocate that faculty use question pools for their test for many of the reasons already identified (minimize cheating, make it easier to reuse the same questions in different tests, publisher questions seem to be zipped as pools).
The question: How do you easily update these pools if you are importing them from a publisher test bank? In my experience, you have to delete the existing pool and tests, upload the new question pool and rebuild your test. Is that the correct workflow or am I overlooking a way to overwrite an existing pool?
Retrieving data ...