On the effectiveness of cognitive feedback from an interface agent

The objective of this study was to determine the impact of task information (TI) provided by an interface agent during the idea evaluation and integration step of the problem formulation stage of the problem solving process. The effectiveness assessment was based on solving diagnostic decision problems in the domain of complex industrial machinery. Ten domain experts participated in this study. Decision support was provided by a case-based reasoning system. Findings suggest that TI provided by the interface agent had no effect on the decision maker's performance, nor on the associated cognitive effort. However, a verbal protocol analysis revealed that the ten subjects used the interface agent to verify their decision processes. The results and their implications are discussed with respect to current findings in the area of decision support systems.