Log in

Sign up for our mailing list!

The D-Lab has partnered with several organizations both on and off campus in order to collaborate on high-impact research projects. If you're interested in working with us, please email dlab@berkeley.edu .

Our project seeks to help explain why many displaced persons from Syria, Afghanistan and other war-torn regions fail to access critical protections and benefits in host states. We are currently building an online platform to fill information gaps and correct the types of miscommunication that prompt refugees to distrust host governments and their services. The website will feature intuitive, interactive data visualization tools to help local stakeholders visualize important trends thematically, spatially, and temporally. Synthesizing information in this way provides a critical resource to asylum seekers, governments and aid organizations, as communication barriers have impeded effective refugee policy. The results of this work could serve as an exemplar for efforts to improve the large communication gap separating asylum seekers and host communities and combat the influence of web-based misinformation campaigns.

Affiliates:
Boalt Law School; BIMI
People:
Katerina Linos, Law School (PI); Laua Jakli: Patty Frontiera, D-Lab; Melissa Carlson; Jasmijn Slotjes, D-Lab/BIMI

The College Futures Foundation seeks to better understand and characterize feeder patterns among educational settings and segments in the transitions for California high school students from high school through receipt of their four-year degrees. D-Lab data scientists are working with College Futures to gather, process and visualize educational data to to better target mechanisms for improving college going and completion and aid efforts to understand common educational pathways in various California geographic regions.

Affiliates:
College Futures Foundation
People:
Jon Stiles; Patty Frontiera; Chris Hench

Since the launch of Donald Trump’s presidential campaign, reports of hate speech targeting various minority groups have risen dramatically. Although this surge is well-reported, it remains difficult to quantify the magnitude of the problem or even properly classify hate speech. To overcome these challenges and others, this study identifies and examines online incidents of hate speech, designing a research methodology that is replicable. We develop a theoretically informed codebook and hand label hate speech in approximately 9,000 online comments sourced from Reddit in June and July 2015 as well as October and November 2016. We subsequently apply supervised machine learning algorithms to differentiate hate speech from non-hate speech on this labelled text. These predictive models can be applied to new text on Facebook, Twitter, The New York Times, and a variety of other platforms, to scalably and automatically identify hate speech. The system offers the potential to track changing patterns of hate speech over time for the creation of an “online hate index.”

Affiliates:
Anti-Defamation League
People:

SAGE Publications is partnering with the D-Lab as one of their first data science online course developers and providers of learner support for SAGE Campus. The partnership has yielded a series of modules that introduce applied data science to social scientists. This series of learning modules demystify the tools and methods of an emerging field that is changing the way we collect, process, and analyze information. The learning modules make extensive use of interactive programming in Jupyter notebooks, a part of the larger Jupyter Project. We use a JupyterHub to host the materials, and students program directly in the web browser from any device.

Affiliates:
SAGE Publications
People:
Claudia von Vacano; Christopher Hench; Geoff Bacon; Evan Muzzall; Patty Frontiera

We are building a digital archive of primary materials related to the three slave conspiracies that occurred in Louisiana in 1791, 1795 and 1810. The focus of the archive will be the testimonies taken from slaves and their allies in the conspiracy. Previously these testimonies have only been available to scholars who have been able to travel to Louisiana, Spain and Cuba to access the official records. We are transcribing, translating, tagging, and collating these testimonies along with other archival documents related to the conspiracies, including new prints of municipal records from the Archivo General de Indies in Seville. D-lab data scientists are using geospatial data, spatial analysis and network analysis to explore new ways to visualize and gain insight on these historical events.

Affiliates:
Department of English
People:
Bryan Wagner (PI); Patty Frontiera; Amani Morrison; Shad Small; Stacy Reardon