January 8, 2023
Does diversity really matter in your evaluation team? The answer is, yes. However, what does a diverse evaluation team look like? There are two components of diversity you need to look for in your evaluation team: Skillset and Lived Experiences. A high quality evaluation team will have analysts with the quantitative and qualitative expertise needed to complete the task. There will be at least one measurement expert, called a psychometrician, on the team. Someone else on the team should have expertise in data communication and data visualization. Certainly, it is possible that a single person will be able to fill all of these skills, but depending upon the complexity of your project it is unlikely. Additionally, you may also want someone with content matter expertise. So, if you are looking for an evaluation team to assess your Full Service Community School program, there needs to be people on the team with education expertise. If you have a grant funded program designed to reduce recidivism, there needs to be people on the team with expertise in working with returning citizens. However, merely having the formalized skill set may not get you to the best evaluations. You also need a team that has diversity through lived experience - whether that is racial, ethnic, gender, low income or other forms of lived experiences that can help the team navigate the situation to be evaluated and work with the population under study. Selecting an appropriately diverse evaluation team is a great start in assuring the highest quality evaluation experience. However, there is one critical component that such a team should have - that is humility. A high quality evaluation team knows regardless of their formalized and lived experiences, they do not know it all. So, they ask questions and listen to the people in the know, prior to designing the evaluation plan and throughout the process of selecting measurements, gathering and analyzing the data, interpreting and presenting the findings, and providing accurate and useful data driven recommendations. If you are looking for that kind of evaluation team, remember, Illumin Analytics is a minority-owned business with the right balance of diverse skill sets and lived experiences. Illumin Analytics will create the appropriately diverse evaluation team for your organization's needs, particularly in the area of assessing organizational efforts in DEIA, implementing the Evidence Act in you Federal Agency, evaluation FSCS, and providing direction for your program designed to reduce recidivism among returning citizens.