In the domain of investigative journalism and artificial intelligence collaboration, precision is paramount. The Marshall Project’s Banned Books Project recently unveiled the intricacies of their journey in harnessing the power of OpenAI’s ChatGPT to decode the complexities of book banning in U.S. state prisons.
Andrew Rodriguez Calderón, a computational journalist at The Marshall Project, shed light on the crucial role of precision in their iterative process. Let’s take a look into their insights, unveiling three essential lessons in the art of prompting and the significance of system prompting in AI endeavors.
The power of precision in the art of prompting
Calderón emphasized that the foundation of meaningful AI work lies in the precision of prompts. To kickstart their project, the team realized that it was essential to lock down with absolute clarity what they aimed to achieve. The initial work involved returning to stakeholders with a preliminary version to assess quality. Surprisingly, the issue wasn’t attributable to AI’s performance but rather to a misalignment between the stakeholders’ expectations and the team’s intended outcomes.
Calderón highlighted that the success of their project hinged on the importance of a precise goal definition. He pointed out that the quality of the AI’s output was not the primary issue; rather, it underscored the significance of aligning all stakeholders with a clear and shared understanding of their intended objectives.
The team at The Marshall Project recognized the paradoxical nature of automation. Sometimes, it’s simpler and more effective to employ human effort rather than attempting to automate every aspect of a project. In their case, the journey didn’t commence with an overinvestment in computer-driven automation. Instead, they manually crafted a substantial portion of early examples, subsequently enlisting ChatGPT for the final leg of the process. This approach allowed them to dedicate significant effort to the critical task of precisely defining their project’s objectives.
Calderón emphasized the critical importance of prioritizing precision from the beginning of their project. He highlighted that their success hinged on a strategic combination of human and AI capabilities, ultimately leading to the clarity necessary for achieving their goals.
The role of system prompting
System prompting, as Calderón described, played a pivotal role in steering ChatGPT toward their desired outcomes. It involved providing additional information to ensure that ChatGPT operated with the same underlying assumptions as a human. This encompassed elements like determining the tone, level of expertise, and handling instructions for the content.
The main prompt used in the Banned Books Project exemplified this approach, outlining the expectations in meticulous detail. Calderón shared the core elements of their system prompt, emphasizing the importance of clear instructions to guide the AI effectively.
Calderón highlighted the role of system prompting in guiding ChatGPT towards outcomes that matched their journalistic goals. He likened it to establishing a set of rules of engagement for the AI, emphasizing its importance in achieving their desired results.
Evaluating the investment of time and efficiency
During the ONA panel discussion, Calderón raised the question of whether the approach resulted in time savings. Interestingly, the team remained divided on this aspect, highlighting the nuanced nature of AI integration. While time may not always be the primary gain, the approach allowed them to shift labor allocation effectively. Sometimes, the benefits extended beyond mere efficiency, touching on cognitive satisfaction, and the creative aspect of problem-solving.
Calderón offered a reflective perspective on the discussion regarding time savings, suggesting that it revealed the intricate dynamics at play in the collaboration between humans and AI. He underscored that the objective extended beyond mere time efficiency, focusing on the optimization of the collective capabilities inherent in their collaborative efforts.
Beyond immediate efficiency gains, the team at The Marshall Project also considered the long-term advantages of their AI project. These encompassed direct reusability of AI-generated content and, perhaps more importantly, an enhanced understanding of how to conceptualize and develop similar projects in the future. The project served as an investment into efficiency over time, contributing to their expertise in utilizing AI effectively.
The art of prompting, when collaborating with generative AI, starts with precision. The Marshall Project’s Banned Books Project exemplified this principle through a meticulous process of defining goals, utilizing human-AI collaboration, employing system prompts, and evaluating the broader gains of their endeavor. Their journey serves as a compelling testament to the importance of precision in the evolving landscape of AI-powered journalism and research.
