| title | tags | ||
|---|---|---|---|
Specific software implementations for realtime EEG/MEG/fMRI/NIRS |
|
This page is part of the documentation series of the FieldTrip buffer for realtime acquisition. The FieldTrip buffer is a standard that defines a central hub (the FieldTrip buffer) that facilitates realtime exchange of neurophysiological data. The documentation is organized in five main sections, being:
- description and general overview of the buffer,
- definition of the buffer protocol,
- the reference implementation, and
- specific implementations that interface with acquisition software, or software platforms.
- the getting started documentation which takes you through the first steps of real-time data streaming and analysis in MATLAB
This page deals with specific implemenations of the FieldTrip buffer protocol. This includes interfacing with specific hardware (e.g., TMSi, Biosemi, CTF, Unicorn), software platforms (e.g., BCI2000, BrainStream) and links to the implementation in specific programming languages (e.g., MATLAB, Java, C/C++, Python).
- ANT NeuroSDK
- Artinis Medical Systems (NIRS)
- BrainVision Recorder
- Biosemi
- CTF (MEG)
- Emotiv
- Neuromag/Elekta/Megin (MEG)
- Jinga-Hi (LFP/EEG)
- Micromed (ECoG)
- ModularEEG/OpenEEG
- Neuralynx (LFP)
- Neurosky ThinkCap
- OpenBCI
- Sound card input
- Siemens fMRI
- TMSI
- TOBI
- Unicorn Hybrid Black
- Java client-side implementation
- Python client-side implementation
- Arduino client-side implementation
- BCI2000 includes the FieldTripBuffer and the FieldTripBufferSource modules
- BrainVision RDA interface allows streaming data in the RDA format
- BrainStream is directly supported through shared MATLAB code
- viewer is a graphical C++ application to visualize online signals from the FieldTrip buffer
- serial_event is a C application that turns incoming characters from a serial port into FieldTrip buffer events (used for translating TTL pulses in realtime fMRI)
- buffer_java#MidiToBuffer is a Java application that turns MIDI messages into FieldTrip buffer events
- buffer_java#MarkerGUI is a graphical Java application that allows to write FieldTrip buffer events with a freely chosen type and value string.
- Testing with sine waves and pre-recorded EEG data
- Testing with pre-recorded fMRI data
There are two applications, based on the FieldTrip buffer, that allow to record an online experiment for later playback at the original "speed", and thus help developers with debugging and testing different analysis schemes. The source code for both can be found in the fieldtrip/realtime/src/utilities/playback directory, binaries are at the usual location in fieldtrip/realtime/bin.
The first application, recording, will act to the outside world as a normal FieldTrip buffer server. Internally, however, every incoming request is also handed to a callback function that stores all incoming data on disk. The program is called like this:
recording someDirectory [port=1972]
This will spawn the callback-enabled buffer server on the given port, create the given directory (which must NOT exist already), and write a plain text file "contents.txt" into that directory. This file is always the same and just contains a general description of the way the recording writes data. Now, each time a header is written, a new subdirectory (starting with 0001) is created, the header is written there in binary and ASCII form, and all further samples and events are also written to binary files. The arrival time of incoming sample and event blocks is measured relative to the arrival time of the header, and logged in an ASCII file called "timing". For stopping the operation, the user may safely press CTRL-C which will close down the server thread and close any open files.
The other application, playback, can be started like this:
playback someDirectory/0001 hostname port
This will replay the data recorded in the first "session" above, at almost exactly the original timing. In contrast to recording, this application will not spawn its own buffer server, but it can only stream data to a remote server. The design rational for this was that you might want to replay an experiment several times, but keep the buffer server running in a similar way as it's done with real acquisition systems.
| Language | Client | Server | Notes |
|---|---|---|---|
| C | yes | yes | Reference implementation, please see here |
| C++ | yes | yes | Thin wrapper classes around the reference implementation for handling client requests, please see here |
| MATLAB | yes | yes | Full support via MEX files, please see here |
| Python | yes | no | this depends on Numpy, please see here |
| Java | yes | no | please see here |
For a real-time BCI system, it is important that a control signal somehow can be used to close the loop towards the subject. Here you can find a description on the options that you have for closing the loop from within your MATLAB-based BCI application.
Current plans and design considerations for building a general pipeline architecture can be found here.