What specifically brought this to my attention is one of the sample questions they provided. The students had to have a misconception of how geology worked in order to get the sample question wrong.
Sample GCI Question #2. The following maps show the position of the Earth's continents and oceans. The o's on each map mark the locations where volcanic eruptions occur on land. Which map do you think most closely represents the places where these volcanoes are typically observed?
A surprising number of students chose the equator/tropics “because it’s warmer there.” This demonstrates that some students often have misconceptions about how geology works. However, I wonder if this portion of students are those that don’t pay attention in class and don’t do their homework? Any rudimentary discussion on plate tectonics covers the Ring of Fire (which was one of the choices) and so they should be able to answer this question. If these are legitimate “studying” students, why are they getting this question wrong?
Assessment tests like this can be useful in finding out what concepts students are not understanding (especially if they are observed in a large portion of the class) and help make us better instructors. But when would you apply this test? The 73 question set is designed for you to make into a 15 question test. I think I would try this test during the middle of the class to see if there are any concepts I need to clear up before continuing. I don’t think it would replace my normal exams with this test because I don’t agree with a bunch of the questions on the test. It may be because I am over-thinking some of them. For example:
3. If the single continent in #73 did exist, how could scientists estimate the time needed for the single continent to break apart and form the arrangement of continents we see today?
(A) Scientists do not yet have a valid method for estimating the time needed to break continents apart.
(B) Through comparison of fossils found in rocks
(C) Through analysis of carbon in rock
(D) Through analysis of uranium and lead in rock
(E) Through comparison of different layers found in rocks
I am guessing the correct answer is (B) fossils and they are using examples like Lystrosaurus that are found in South America and Africa. However, the rifting phase also generates a lot of igneous rock so U/Pb dating is also possible. While (E) is a little more ambiguous and doesn’t give us time (without fossil or isotope data), it’s exactly what geologists do. We compare layers of rocks and we can compare those in South America and Africa and find similarities that tell us they used to be together.
They designed this multiple-choice test to have answers that are ambiguous along with the correct answer. I find those tests particularly difficult because you can over-think them. You can usually think of a reason to include another answer (especially frustrating if it’s choose all that apply), but you don’t have any way to explain your choices. I think that’s what demonstrates real knowledge, having to explain why you chose those answers. I understand they chose multiple-choice for ease of grading, but I think tests where students have to demonstrate their knowledge are better (but much more time consuming to grade).
