A data logger is a device that records sensor information at regular intervals over a period of time so that information can be examined later for an understanding of phenomenon that are hard to observe directly. This project has been running since late 2013, and the site is now peppered with many different logger designs that arose naturally over time as we tackled different research questions.
THIS PAGE is a consolidated set of links to the different “how to build” tutorials that we’ve released over time, with some commentary to put them in context.
(OR: you can skip the background details, and jump directly to the latest build information here)
If you are just getting started with Arduino then this might be a good time to review some of the great background material that you can find on the web . The hardware side of the Arduino platform isn’t actually that unique: it’s just a circuit board built around an Atmel AVR micro controller chip with connections broken out so you can attach wires to it more easily. It is really the software development environment (called the IDE) that makes programming the Arduino easy for beginners. The IDE handles a lot of messy details when converting the code you’ve written into something that will run on that little processor. Because those low level details are taken care of, you can run essentially the same program on many different flavors of Arduino – even if they look look different different physically.
Most people who are just discovering Arduino start with the UNO. It’s a relatively large board, and robust enough for the physical handling you see in a classroom situation. We have posted several tutorials for the UNO that are suitable for beginners, with the hope that that teachers will use this material to create their own Arduino-based lessons. UNO’s don’t run very long on batteries, but they are a fantastic platform for learning programming and electronics.
While it might not be immediately obvious, tutorial #4 is probably the most important one in the set for teachers. The serial plotter which comes with the IDE makes it possible to view live sensor output simply by adding one print statement to the code. This updates a graph live on screen by sending the numbers over the USB cable attached to a laptop. Nothing I’ve used before lets you do real-time demos so easily, and more advanced use of that plotter functionality allows you to capture those displays and replicate some tasks that would normally require an oscilloscope costing 10x as much.
The drawback of most larger Arduinos is that they are built for ease of use, rather than being optimized for low power operation. Since this project is building data loggers that have to run for several years on one set of batteries we use smaller Pro-Mini style Arduinos, which we modify by removing a few light-emitting diodes and changing the regulator to extend the operating time. There are some important differences between Arduino models in terms of pin locations and operating voltage, but the key thing to realize is that once you get your UNO based logger recording sensor data, you should be able to transfer that code into to a Pro-Mini based build with few (if any) changes to the programming. This gives you a development path, where your prototypes get smaller and more energy efficient as your skills improve, with some people reaching the point of using raw processors from the AVR family to create custom sensors. Or if your code grows to the point where you are exceeding the available memory of a standard 328P, you can switch to a board with a 1284P processor. Since October 2016, Arduino’s are also being made with 32-bit ARM CortexM3 microcontrollers, which will coexist with the more limited 8-bit AVRs. ARM and AVR are not compatible at the lowest level, but they can be programmed with the same IDE and most beginner level programs compile for the two chip families without significant changes.
This project started building data loggers with smaller Pro Mini style Arduinos in 2014, using a generic wiring plan to enable future development:
In 2015 we released our first series of step-by-step tutorials to guide people who wanted to build these stand-alone loggers for their own projects:
There is an additional assembly tutorial with suggestions for achieving better power optimization, but that material is somewhat advanced so it’s a good idea to get a few of the basic three-module loggers running before tackling those modifications. (Note that more recent designs are faster & easier for beginners than the 2015 model)
In 2018 we published our first academic paper: A Flexible Arduino-Based Logging Platform for Long-Term Monitoring in Harsh Environments This open-access publication is free to download, and describes real world deployments that show how modifying both the logger and the housing enable us to monitor different aspects of groundwater flow with similar sensors. The “modules & jumper wires” approach used by this project makes it easy to create prototypes to suit different research questions, and other groups are now taking advantage of this flexibility; extending the basic 3-module design with new housings & sensor configurations.
In 2019: As part of our ongoing commitment to science education, we’ve updated the “fully soldered” version of the “EDU” Cave Pearl Logger and developed a simplified version that uses Dupont connectors to reduce assembly time. Dr. Beddow’s instrumentation class has been building the 2016 release for more than three years, and student feedback motivated a new layout that’s easier to reconfigure for different projects, while still keeping within the time constraints of a typical lab schedule. YouTube videos explain the assembly in enough detail for beginners, and the new logger program starting point provides a functional temperature & light level recorder right away. (For an idea of how useful this tool could be in an educational context, see the post about using the classroom logger to test plant stress with a normalized vegetation index.) Microcontroller based sensors like this will become a standard part of the earth & environmental science curriculum, and we hope this new build supports other STEM educators who want to add Arduino based experiments to their teaching portfolio.
The 4″ PVC housing from 2016 used a rubber end cap, which can only be submerged to ~ 5m before water pressure compresses the flexible bottom too much. Many of our deployment sites are much deeper than that, so we also developed a stronger underwater housing and inexpensive underwater connectors so that sensors can be placed at the end of long cables. The core of the logger is still built around the same modules as the 4″ build, but they are re-arranged to fit inside the 2″ PVC pipe. We’ve also been developing methods to add 5110 LCD & OLED display screens using the lowest possible amount of power & system memory.
There are many sensor tutorials the site, and we are constantly developing new methods for calibrating inexpensive sensors to research standards:
- Adding Sensors to Your Arduino Data Logger
- How to Configure I²C Sensors with Arduino
- ‘No-Parts’ Temperature Measurements with Arduino
- How to increase the resolution of the ADC by Oversampling
- How to make ‘high-resolution’ sensor readings on DIGITAL I/O pins
- Using a $1 DS3231 Real-time Clock Module
- Measuring EC ( electrical conductivity ) with Arduino
- Using an MS5803 high resolution pressure sensor
- How to calibrate a compass (and accelerometer)
- Calibrating Oversampled Thermistors
- Calibrating DS18B20 1-Wire sensors
- Make a ‘Plant Health’ Sensor with two LEDs
I hope that by the time you’ve built few of these loggers, you’ll be able to find all the other material on this site via the search box on the upper right hand corner. In addition, progress summaries are shown there for some of the instruments I’m currently working on. Below that you will find a very long list of links to other Arduino projects that I found helpful or interesting. If you get stuck on something, leave a comment on the related page of this blog or post your questions to the forums at Arduino.cc – especially if you are trying to build something for your own research using a sensor I have not worked with yet. Arduino.cc is by far the best resource available for beginners, and I always start my searches there.
Good luck with your project!