The session explored the transformative role AI can play in evaluating research, particularly by expanding access to advanced academic assessment tools.
TRENDS Global, through the TRENDS Canada Virtual Office, organized a lecture titled Artificial Intelligence (AI) and the Democratization of Academic Peer Review: Canada’s Syllogos Platform as a Case Study. The lecture was delivered by Zeyyad Saleh, Lead Developer of the Syllogos platform at the Université de Montréal and a specialist in political economy and artificial intelligence. Noor Al-Mazrouei, Senior Researcher and Director of the AI Studies Department at TRENDS, moderated the session.
The session explored the transformative role artificial intelligence can play in evaluating research, particularly by expanding access to advanced academic assessment tools and improving research quality.
The discussion began with the premise that, amid the rapid growth of academic output, the principal challenge facing researchers is no longer access to knowledge itself, but the ability to assess its quality and reliability. Against this backdrop, the lecture highlighted the importance of democratizing research evaluation by making the standards and expertise traditionally employed by peer reviewers and experienced scholars more transparent and accessible to researchers, while preserving the rigor of academic assessment.
As a case study, the lecture examined Syllogos, a Canadian AI-powered platform designed to provide analytical evaluations of research papers and scholarly books based on criteria inspired by the peer-review practices of leading academic journals and publishing houses. The platform is intended to help researchers identify the strengths and weaknesses of their work and refine it before submission for publication.
During a live demonstration, participants observed how the platform evaluated research studies of varying quality. The demonstration showcased the ability of AI applications such as Syllogos to distinguish between strengths and shortcomings while supporting their assessments with evidence and reasoning drawn directly from the texts under review. It also illustrated how AI can make the evaluation process more transparent and comprehensible, transforming peer review into a tool for learning and research improvement rather than merely a final judgment.
The lecture emphasized that the use of artificial intelligence in this field is not intended to replace researchers or peer reviewers, but rather to establish a complementary relationship between human expertise and technology. AI can assist in organizing evidence, analyzing research, and identifying strengths and weaknesses, while the final scholarly judgment remains the responsibility of human experts.
The session also underscored the importance of moving toward a more transparent, reviewable, and educational evaluation process, enabling researchers not only to receive an assessment but also to understand the reasoning and criteria underpinning it.
The lecture concluded that the broader value of AI applications such as Syllogos lies in their ability to connect the democratization of research evaluation with the enhancement of research quality. By promoting a culture of critical assessment, such tools can help transform evaluation from a stage confined to the publication process into a continuous practice that accompanies the entire knowledge-production cycle.
