Tech Blog: How the Ocean Observatories Initiative Used Apache Kafka to Simultaneously Combine Large Volumes of Historic and Streaming Data

By Choonhan Youn What is Apache Kafka? Apache Kafka is a distributed messaging system, which publishes and subscribes to streams of records, similar to a message queue or enterprise messaging system. It is developed to be a distributed, partitioned, replicated service. Ocean Observatories Initiative (OOI)’s data streaming-based science gateway uses this message brokering system. To balance the incoming load, Topics are defined and each of these Topics is split into multiple...

Science Ambassador Blog: Neuroscience Gateway as a Tool for Big Data Analysis

One of our five Science Ambassadors , James Trevathan, Postdoctoral Fellow at the University of Wisconsin-Madison, attended  OptoDBS2019  in June 2019 as well as the Neuroscience Gateways workshop on Large Scale Simulations and Data Processing in October 2019. James presented “Calcium imaging via a miniature microscope for studying deep brain stimulation in a freely moving animal model of disease.” By James Trevathan Thanks to the support of the SGCI Science Ambassadors,...

Focus Week Participants Gain a Fresh Perspective on Their Gateways

The sixth Gateway Focus Week cohort met in September in Chicago, IL. Offered twice per year, the intensive week-long workshop addresses the importance of having some level of business know-how in order to achieve sustainability for science gateway projects.

Gateways 2019 Conference Provides a Perfect Venue for Gateway Creators & Enthusiasts

The annual Gateways conference is the perfect venue for gateway creators and enthusiasts to come together, learn from each other, and exchange ideas. This year, 127 participants gathered at the Catamaran Resort and Spa in San Diego, CA, from September 23-25.

Tech Blog: Collecting Docker Metrics Using Python and Prometheus

By Julia Looney Check out Julia's webinar: Collecting Docker metrics with Python and Prometheus . What is Prometheus? Prometheus allows you to create and use time-series metrics for monitoring, alerting, and graphing. Features of Prometheus open source uses time-series data metrics are specified with a name and key/value pairs uses a query language, PromQL, to allow you to create more flexible monitoring data collection for the time series data occurs...

Hack@PEARC19 Participants Solved Real Problems Faced by Gateways

Now in its second year, the Hack@PEARC19, which took place in July 2019, attracted sixteen up-and-coming programmers who participated in the social coding event to solve real problems faced by gateways.

2019 Summer Internship Reports: Michaud Reyna

Each year, our Workforce Development team offers summer internships for students interested in developing their gateway development skills. Interns are placed at one of several SGCI partner sites. This post features SGCI summer 2019 intern Michaud Reyna, a senior at Morehouse College.

2019 Summer Internship Reports: Gilbert Curbelo III

Each year, our Workforce Development team offers summer internships for students interested in developing their gateway development skills. Interns are placed at one of several SGCI partner sites. This post features SGCI summer 2019 intern Gilbert Curbelo III, a recent graduate of California State University, Monterey Bay.

2019 Summer Internship Reports: Andrea Dumalagan

Each year, our Workforce Development team offers summer internships for students interested in developing their gateway development skills. Interns are placed at one of several SGCI partner sites. This post features SGCI summer 2019 intern Andrea Dumalagan, a senior at Rutgers University.

2019 Summer Internship Reports: Iakov Vasilyev

Each year, our Workforce Development team offers summer internships for students interested in developing their gateway development skills. Interns are placed at one of several SGCI partner sites. This post features SGCI summer 2019 intern Iakov Vasilyev, a junior at the University of California, San Diego.

More than just everyday musings...

Have an idea for a topic you’d like to share (or you’d like us to write)? Let us know! Email help@sciencegateways.org with your idea.