Text Analysis

Twitter Text Analysis: A Friendly Introduction

October 25, 2022
Mingyu Yuan

Read part 2 here.

Introduction

Text analysis techniques, including sentiment analysis, topic modeling, and named entity recognition, have been increasingly used to probe patterns in a variety of text-based documents, such as books, social media posts, and others. This blog post introduces Twitter text analysis, but is not intended to cover all of the aforementioned topics. The tutorial is broken down into two parts. In this very first post, I...

Peter Amerkhanian

Graduate Student Researcher (GSR), Instructor
Goldman School of Public Policy (GSPP)

I’m a D-Lab GSR and a graduate student in The Goldman School’s Master of Public Policy/The I School’s Graduate Certificate in Applied Data Science. I have 5 years of experience working on data problems in government and nonprofits. I’m interested in social policy, program evaluation, and computational methods. Python is my principal language, but I’ve developed experience using and teaching a variety of other tools, including R, Excel, Tableau, and JavaScript. I deeply enjoy teaching data science methods and am excited to be a part of the D-Lab.

Aniket Kesari, Ph.D.

Former D-Lab Postdoc and Senior Data Science Fellow
Berkeley Law

Aniket Kesari was a postdoc and data science fellow at D-Lab. He is currently a research fellow at NYU’s Information Law Institute, and will join the faculty of Fordham Law School in 2023. His research focuses on law and data science, with particular interests in privacy, cybersecurity, and consumer protection.

Featured D-Lab Blog Post: Introducing “A Three-Step Guide to Training Computational Social Science Ph.D. Students for...

Bo Yun Park, Ph.D.

Postdoc
D-Lab

I am a Postdoctoral Scholar in the D-Lab at the University of California, Berkeley. My research lies at the intersection of political, cultural, and transnational sociology. I am particularly interested in dynamics of social inclusion and exclusion, social change, technology, and digital politics. My dissertation investigated how political strategists in France and the United States craft narratives of political leadership for presidential candidates in the digital age. I received my Ph.D. in Sociology at Harvard University, where I was affiliated with the Institute for Quantitative Social...

Abhishek Roy

IUSE Undergraduate Advisory Board
Economics
Data Science

I'm Abhishek Roy and I'm double majoring in Economics and Data Science. I've been a part of D-Lab's IUSE project since Spring 2020 and have truly found an organization that is not only passionate about Data Science but also strives to expand its reach equitably to all communities. I am involved in Research and Project Management roles in various departments and labs at Berkeley and I'm an Editor at the Berkeley Economic Review. I love diving into anything at the intersection of Data Science, Economics, Business, and Computational Social Science. Whenever I'm free, I love writing...

Ella Belfer

Consultant
Energy and Resources Group

Ella is a PhD student in the Energy and Resources Group. Her research examines water governance in a changing climate, drawing on geo-spatial techniques. Her past work includes applications of topic modelling in climate change adaptation research, and inductive coding of semi-structured interviews.

Erin Manalo-Pedro

Research Fellow
Community Health Sciences (UCLA)

Erin Manalo-Pedro is a Ph.D. student in the Department of Community Health Sciences at the UCLA Fielding School of Public Health with a minor in education. She focuses her racial health equity research on curriculum, the health workforce, and political interventions for communities of color. Drawing from Public Health Critical Race Praxis and Pinayism, she aims to use methods, like natural language processing and counter storytelling, to document the subtleties of structural racism and resistance from marginalized groups.

To guide her interdisciplinary approach, Erin leverages...

Katherine Wolf

Adjunct Fellow
Environmental Science, Policy, and Management

Doctoral student in Rachel Morello-Frosch's laboratory in the Department of Environmental Science, Policy, and Management working at the intersection of environmental epidemiology, environmental justice, and causal inference. Particularly interested in developing quantitative methods to investigate the operation of social power in environmental monitoring regimes in the United States.

Spencer Le

Data Peer Consultant, UTech
Computer Science
Data Science

I am a senior majoring in Computer Science and minoring in Data Science. I love crunching down big data and analyzing it in order to help solve real-life issues. In my free time, I like jamming out to music, drawing, studying history, and posting on my foodstagram. If you have any questions regarding Computer Science or Data Science, please stop by!

Twitter data extraction with Selenium

March 1, 2022
Seyi Olojo

Introduction

With online communities and social networks serving as important sites for computational social science research, Twitter has quickly become a popular data source for researchers (Frey et al. (2020), Kusen et al. (2017), Rao et al. (2010) and Ru et al. (2021)). This blog post will demonstrate one way to extract twitter data without using the Twitter API. This is especially useful for researchers who are new to exploring the use of Twitter data in their research, looking to develop a baseline corpus for a research question they are newly...