R

A Brief Introduction to Cloud Native Approaches for Big Data Analysis

March 20, 2023
by Millie Chapman. Satellites, smart phones, and other monitoring technologies are creating vast amounts of data about our earth every day. These data hold promise to provide global insights on everything from biodiversity patterns to human activity at increasingly fine spatial and temporal resolution. But leveraging this information often requires us to work with data that is too big to fit in our computer's "working memory" (RAM) or even to download to our computer's hard drive. In this post, I walk through tools, terms, and examples to get started with cloud native workflows. These workflows allow us to remotely access and query large data from online resources or web services, all while skipping the download step!

James Hall

Consultant
Department of Statistics

James Hall is a graduate student in the Statistics MA program at University of California, Berkeley. He is a husband and father to three awesome kids. Originally from Baltimore, MD, James earned his bachelors in Mathematics at the United States Military Academy at West Point, NY in 2011, and served as a U.S. Army officer. He’s served as a leader at multiple levels within large organizations with a professional focus on visualizing and communicating complex analysis to decision makers. James’ experience and coursework give him expertise in navigating different statistical methods,...

Michael Ruiz

IUSE Research Team
Psychology

Michael earned his B.A.in Psychology from UC Berkeley and currently works as the manager of Professor Okonofua's Equity, Diversity, and Empathy Navigation Sciences Lab in the UC Berkeley Psychology department.

Suraj Nair

Data Science Fellow
School of Information

I am a PhD Student at the School of Information. My research interests lie at the intersection of development economics and machine learning, with a focus on the use of large scale digital data and new computational tools to study pressing issues in global development.

Emma Turtelboom

Data Science Fellow
Astronomy

I am a PhD student in the Astronomy department, and I study planets outside our own solar system. I'm interested in learning how the properties of host stars affect planetary systems. In my free time, I love swimming, hiking, reading, and baking.

Leïla Njee Bugha

Data Science Fellow
Agricultural and Resource Economics

Leïla Njee Bugha is a 5th year PhD candidate in the Agriculture and Resources Economics department. She studied at the École Normale Supérieure de Paris-Saclay and at Sciences Po Paris in France, before starting a career in the field of program evaluation of public policies. Most recently, she worked as a Research Analyst at the International Food Policy Research Institute in Washington, DC, evaluating childhood nutrition and social protection programs in West Africa. As a PhD student, she specializes in development and labor economics, with a focus on understanding the barriers to...

Monica Donegan

Data Science Fellow
Environmental Science, Policy, and Management

Monica is a third-year Ph.D. candidate in the Environmental Science, Policy, and Management program. She uses computational tools to study the evolution and ecology of agricultural plant pathogens. Previously, she worked on a data science team at a biotech company in Boston.

Cheng Ren

Senior Data Science Fellow
School of Social Welfare

Cheng Ren is a D-Lab Senior Data Science Fellow and a Ph.D. student at the School of Social Welfare. His research interests are community engagement and assessment, nonprofit development, community database, computational social welfare, and data for social goods.

Wadzanai Makomva

Discovery Graduate Fellow
School of Information

Wadzanai is a graduate student at the School of Information and she is a part of the MIMS program. She has a vested interest in the integration between data science, technology and developmental surveillance techniques. She has prior experience working as a quantitative analyst in project management consulting within a professional services firm, public health, and most recently in sustainable construction materials. Wadzanai is particularly interested in increasing access of STEM subjects and fields to under-privileged women of color in the African continent, particularly her home...

Aniket Gupta

Discovery Fellow
School of Information

I am a first year masters student at UC Berkeley school of Information majoring in Information Management and Systems with a focus on Data Science and ML. I like to build optimized yet simple and scalable solutions powered by data using emerging AI technologies.