SEEMQTT: Secure End-to-End MQTT-based Communication for Mobile IoT Systems Using Secret-Sharing and Trust Delegation.
The system contains these main components:
- The publisher which runs on the ESP32 platform (see ESP32)
- The Keystrors. Each Keystore can run on a separate RPI or a regular PC (see KeyStore)
- The Subscriber which receives the information published by the publisher (see the folder Subscriber)
- Security credentials. To set up such security credential, you may need to use the Key Generator tool (see Tools) and the KeyNote trust managment system (see KeyStore\KeyNote).
- Finally, you need to install an MQTT broker.
In SEEMQTT project, we use ESP32 board as an MQTT publisher and use Arduino IDE for programming ESP32 board. We implement the Boneh-Franklin Identity-Based Encryption (BF-IBE) based on GMP and PBC libraries. We cross-compile both libraries for the ESP32 board. We present here the cross-compilation exmaple of GMP and PBC libraries for ESP32 board. You can do the Cross-Compilation by following instructions below or simply use our precompiled libraries, which you can find them in ESP32/esp32_crosscompile.
Following step 2-4 for cross-compilation or you can jump directly to step 5 using our pre-compiled GMP and PBC libraries.
Installation of Arduino IDE and necessary plugins for ESP32 board.
click for details
-
Arduino IDE
We install Arduino IDE (version 1.8.13) on Linux machine. Follow the instructions to install Arduino IDE on your PC (Windows/Mac OS X/Linux/Portable IDE/ChromeOS):
https://www.arduino.cc/en/Guide/HomePage -
Install ESP32 Board Add-Ons in Arduino IDE
We use ESP32 Boards in our project. Follow the instructions in this tutorial to add add-ons for ESP32 Boards in Arduino IDE:
https://randomnerdtutorials.com/installing-the-esp32-board-in-arduino-ide-windows-instructions/ -
Required libraries in Arduino IDE
We need to install PubSubClient library, which is used in our project for MQTT client. Here is a description about how to install a library into your Arduino IDE: https://www.arduino.cc/en/guide/libraries
GMP is a free library for arbitrary precision arithmetic, operating on signed integers, rational numbers, and floating-point numbers.
click for details
- you need to download the GMP library source code from here: https://gmplib.org
- after unzip the library, create a text file and save it as e.g. cross-compile-esp32.txt.
- copy the next code ( A wrapper around ./configure (ikalchev/kpabe-yct14-cpp#2).) into the file and change the paths according to your own settings.
- After running the text file we just generated, a config.h file will be generated.
#!/bin/bash
# Don't forget:
# - Change HAS_OBSTACK_VNPRITNF and HAVE_NL_LANGINFO to 0 from config.h
# - (optional) Change HAS_ALLOCA and HAS_ALLOCA_H to 0 (we want to avoid stack allocation on the esp)
# - Change HAVE_RAISE to 0 (see invalid.c)
./configure \
--enable-static \
--disable-shared \
--host=xtensa \
--prefix=/usr/local/lib/xtensa-esp32-elf \
AR=/home/mao/Desktop/esp/xtensa-esp32-toolchain/xtensa-esp32-elf/bin/xtensa-esp32-elf-ar \
ARFLAGS=rcs \
RANLIB=/home/mao/Desktop/esp/xtensa-esp32-toolchain/xtensa-esp32-elf/bin/xtensa-esp32-elf-ranlib \
CC=/home/mao/Desktop/esp/xtensa-esp32-toolchain/xtensa-esp32-elf/bin/xtensa-esp32-elf-gcc \
CFLAGS="-Wno-error=deprecated-declarations -Wno-unused-parameter -Wno-sign-compare -Os -g3 -nostdlib -Wpointer-arith -Wno-error=unused-function -Wno-error=unused-but-set-variable -Wno-error=unused-variable -mlongcalls -ffunction-sections -fdata-sections -fstrict-volatile-bitfields" \
CXX=/home/mao/Desktop/esp/xtensa-esp32-toolchain/xtensa-esp32-elf/bin/xtensa-esp32-elf-g++ \
CXXFLAGS="-fno-rtti -fno-exceptions -std=gnu++11" \
LIBS="" \
LDFLAGS="-L/home/mao/.arduino15/packages/esp32/hardware/esp32/1.0.4/tools/sdk/lib -L/home/mao/.arduino15/packages/esp32/hardware/esp32/1.0.4/tools/sdk/ld -nostdlib -Wl,-static -Wl,-gc-sections -Wl,-EL -Wl,--undefined=uxTopUsedPriority"
chmod +x cross-compile-esp32.txt && ./cross-compile-esp32.txt
- Change HAVE_OBSTACK_VPRINTF, HAVE_NL_LANGINFO and HAVE_RAISE to 0 from config.h. Note: in our case, a error occurs during linking stage when we use pre-compiled libgmp.a library in Arduino (1.8.13). As a workaround we copy the lines below from invalid.c to errno.c.
#if ! HAVE_RAISE
#define raise(sig) kill (getpid(), sig)
#endif
- Run
make && make installto generate static library libgmp.a, which will be located in our case under folder /usr/local/lib/xtensa-esp32-elf/lib. - Done
The PBC (Pairing-Based Cryptography) library is a free C library (released under the GNU Lesser General Public License) built on the GMP library that performs the mathematical operations underlying pairing-based cryptosystems.
click for details
- PBC library source code download: https://crypto.stanford.edu/pbc/download.html
- A wrapper around ./configure (ikalchev/kpabe-yct14-cpp#2). Change the paths according to your own settings and save it as e.g. cross-compile-esp32.txt. After running the script, a config.h file will be generated.
#!/bin/bash
# The many includes in CPPFLAGS are all because of arith/init_random.c, as it is modified to use the random number generator from the esp platform.
# Don't forget:
# - Change HAVE_ALLOCA and HAVE_ALLOCA_H to 0 (we don't want to use stack allocation on the esp)
TOOLCHAIN="/home/mao/Desktop/esp/xtensa-esp32-toolchain/xtensa-esp32-elf/bin/xtensa-esp32-elf-"
./configure \
--enable-static \
--disable-shared \
--host=xtensa \
--prefix=/usr/local/lib/xtensa-esp32-elf \
AR="$TOOLCHAIN"ar \
ARFLAGS=rcs \
AS="$TOOLCHAIN"as \
RANLIB="$TOOLCHAIN"ranlib \
NM="$TOOLCHAIN"nm \
CC="$TOOLCHAIN"gcc \
CFLAGS="-Wno-error=deprecated-declarations -Wno-unused-parameter -Wno-sign-compare -Os -g3 -nostdlib -Wpointer-arith -Wno-error=unused-function -Wno-error=unused-but-set-variable -Wno-error=unused-variable -mlongcalls -ffunction-sections -fdata-sections -fstrict-volatile-bitfields" \
CPPFLAGS="-mlongcalls -fno-exceptions -I/usr/local/lib/xtensa-esp32-elf/include -I/home/mao/Desktop/esp/xtensa-esp32-toolchain/xtensa-esp32-elf/include -I/home/mao/.arduino15/packages/esp32/hardware/esp32/1.0.4/tools/sdk/include/esp32/ -I/home/mao/.arduino15/packages/esp32/hardware/esp32/1.0.4/tools/sdk/include/driver/ -I/home/mao/.arduino15/packages/esp32/hardware/esp32/1.0.4/tools/sdk/include/soc/ -I/home/mao/.arduino15/packages/esp32/hardware/esp32/1.0.4/tools/sdk/include/freertos/" \
LIBS="" \
LDFLAGS="-L/usr/local/lib/xtensa-esp32-elf/lib/ -L/home/mao/.arduino15/packages/esp32/hardware/esp32/1.0.4/tools/sdk/lib -L/home/mao/.arduino15/packages/esp32/hardware/esp32/1.0.4/tools/sdk/ld -L/home/mao/Desktop/esp/xtensa-esp32-toolchain/xtensa-esp32-elf/lib -nostdlib -Wl,--gc-sections -Wl,-EL -Wl,--undefined=uxTopUsedPriority"
chmod +x cross-compile-esp32.txt && ./cross-compile-esp32.txt
- Change HAVE_ALLOCA and HAVE_ALLOCA_H to 0 from config.h.
- Run
make && make installto generate static library libpbc.a, which will be located in our case under folder /usr/local/lib/xtensa-esp32-elf/lib. - Done
In order to use our pre-compiled GMP and PBC libraries (libgmp.a and libpbc.a) in Arduino, we need to construct the folders in correct format for them under Arduino/libraries.
See also the specification from Arduino: https://arduino.github.io/arduino-cli/library-specification/
click for details
- Constructed GMP library folder
Arduino/libraries/gmp
├── library.properties
└── src
├── esp32
│ └── libgmpesp32.a
└── gmp.h
- Copy header files and pre-compiled GMP library from /usr/local/lib/xtensa-esp32-elf/ to Arduino library folder and libgmp.a is renamed as libgmpesp32.a in order to differ from the GMP library under linux machine.
- library.properties file. Note: set precompiled flag to true.
name=GMP Library ESP32
version=1.0.0
author=Hangmao Liu
maintainer=Hangmao Liu
sentence=Arduino libary
paragraph=
category=demo
url=www.google.com
architectures=*
includes=gmp.h
precompiled=true
ldflags=-lgmpesp32
- Constructed PBC library folder
Arduino/libraries/pbc/
├── library.properties
└── src
├── esp32
│ └── libpbcesp32.a
├── pbc_a1_param.h
├── pbc_a_param.h
├── pbc_curve.h
├── pbc_d_param.h
├── pbc_e_param.h
├── pbc_field.h
├── pbc_fieldquadratic.h
├── pbc_f_param.h
├── pbc_fp.h
├── pbc_g_param.h
├── pbc.h
├── pbc_hilbert.h
├── pbc_i_param.h
├── pbc_memory.h
├── pbc_mnt.h
├── pbc_multiz.h
├── pbc_pairing.h
├── pbc_param.h
├── pbc_poly.h
├── pbc_random.h
├── pbc_singular.h
├── pbc_ternary_extension_field.h
├── pbc_test.h
├── pbc_utils.h
└── pbc_z.h
- Copy header files and pre-compiled PBC library from /usr/local/lib/xtensa-esp32-elf/ to Arduino library folder and libpbc.a is renamed as libpbcesp32.a in order to differ from the PBC library under linux machine.
- library.properties file. Note: set precompiled flag to true.
name=PBC_Library(Pairing Based Cryptography) ESP32
version=1.0.0
author=Hangmao Liu
maintainer=Hangmao Liu
sentence=Arduino libary
paragraph=
category=demo
url=www.google.com
architectures=*
includes=pbc.h
precompiled=true
ldflags=-lpbcesp32
See also the discussion for more details: https://forum.arduino.cc/index.php?topic=653746.0
platform.txt: file is located in ~/.arduino15/packages/esp32/hardware/esp32/1.0.4 (under normal user not root).
- Add this line anywhere in platform.txt
compiler.libraries.ldflags=
- Add {compiler.libraries.ldflags} to recipe.c.combine.pattern
recipe.c.combine.pattern="{compiler.path}{compiler.c.elf.cmd}" {compiler.c.elf.flags} {compiler.c.elf.extra_flags} {compiler.libraries.ldflags} -Wl,--start-group {object_files} "{archive_file_path}" {compiler.c.elf.libs} -Wl,--end-group -Wl,-EL -o "{build.path}/{build.project_name}.elf"
- Add this tow flages the end of the file
compiler.c.elf.libs=-lgcc -lesp32 -lphy -lesp_http_client -lmbedtls -lrtc -lesp_http_server -lbtdm_app -lspiffs -lbootloader_sup port -lmdns -lnvs_flash -lfatfs -lpp -lnet80211 -ljsmn -lface_detection -llibsodium -lvfs -ldl_lib -llog -lfreertos -lcxx -lsmar tconfig_ack -lxtensa-debug-module -lheap -ltcpip_adapter -lmqtt -lulp -lfd -lfb_gfx -lnghttp -lprotocomm -lsmartconfig -lm -leth ernet -limage_util -lc_nano -lsoc -ltcp_transport -lc -lmicro-ecc -lface_recognition -ljson -lwpa_supplicant -lmesh -lesp_https_ ota -lwpa2 -lexpat -llwip -lwear_levelling -lapp_update -ldriver -lbt -lespnow -lcoap -lasio -lnewlib -lconsole -lapp_trace -les p32-camera -lhal -lprotobuf-c -lsdmmc -lcore -lpthread -lcoexist -lfreemodbus -lspi_flash -lesp-tls -lwpa -lwifi_provisioning -l wps -lesp_adc_cal -lesp_event -lopenssl -lesp_ringbuf -lfr **-lgmpesp32** **-lpbcesp32** -lstdc++
In our case, an error occurs during linking stage.
in libc_nano.a undefined reference to "_PathLocale"
in libc_nano.a undefined reference to "__mlocale_changed"
in libc_nano.a undefined reference to "__nlocale_changed"
As a workaround we define those 3 variables in gmp/errno.c file, since we have already modified it.
int _PathLocale = 0;
int __mlocale_changed = 0;
int __nlocale_changed = 0;
User can find a pre-compiled version of both libraries in the folderESP32/esp32_crosscompile To use these libraries, you must:
click for details
Locating the Arduino libraries folder:
- in case of using Linux: Arduino/libraries/
- in case of using Windows 10: C:\Users\usename\Documents\Arduino\libraries
Locating the platform.txt:
- in case of using Linux: ~/.arduino15/packages/esp32/hardware/esp32/1.0.4(under normal user not root)
- in case of using Windows 10: *C:\Users\usename\AppData\Local\Arduino15\packages\esp32\hardware\esp32\1.0.4*
After locating the file:
- Add this line anywhere in platform.txt
compiler.libraries.ldflags=
- Add {compiler.libraries.ldflags} to recipe.c.combine.pattern
recipe.c.combine.pattern="{compiler.path}{compiler.c.elf.cmd}" {compiler.c.elf.flags} {compiler.c.elf.extra_flags} {compiler.libraries.ldflags} -Wl,--start-group {object_files} "{archive_file_path}" {compiler.c.elf.libs} -Wl,--end-group -Wl,-EL -o "{build.path}/{build.project_name}.elf"
- Add this tow flages ( -lgmpesp32 -lpbcesp32 ) the end of the file compiler.c.elf.libs=
compiler.c.elf.libs=-lgcc -lesp32 -lphy -lesp_http_client -lmbedtls -lrtc -lesp_http_server -lbtdm_app -lspiffs -lbootloader_sup port -lmdns -lnvs_flash -lfatfs -lpp -lnet80211 -ljsmn -lface_detection -llibsodium -lvfs -ldl_lib -llog -lfreertos -lcxx -lsmar tconfig_ack -lxtensa-debug-module -lheap -ltcpip_adapter -lmqtt -lulp -lfd -lfb_gfx -lnghttp -lprotocomm -lsmartconfig -lm -leth ernet -limage_util -lc_nano -lsoc -ltcp_transport -lc -lmicro-ecc -lface_recognition -ljson -lwpa_supplicant -lmesh -lesp_https_ ota -lwpa2 -lexpat -llwip -lwear_levelling -lapp_update -ldriver -lbt -lespnow -lcoap -lasio -lnewlib -lconsole -lapp_trace -les p32-camera -lhal -lprotobuf-c -lsdmmc -lcore -lpthread -lcoexist -lfreemodbus -lspi_flash -lesp-tls -lwpa -lwifi_provisioning -l wps -lesp_adc_cal -lesp_event -lopenssl -lesp_ringbuf -lfr **-lgmpesp32** **-lpbcesp32** -lstdc++
You can find the SEEMQTT library here. To use the library:
Locating the Arduino libraries folder:
- in case of using Linux: Arduino/libraries/
- in case of using Windows 10: C:\Users\usename\Documents\Arduino\libraries
Few papramertrs in secconfig.h need to be spesifiecd before running any publisher.
KSN_NUM // The number of KeyStores.
SSS_T // Shamir's secret sharing threshold. this should be consistent with the parameter selected in the publisher
To compile and run the Keystroe components, you need to install IBE, MQTT client, and OpenSSL libraries. In our setup, the Keystores were running on Raspbery Pi 4.
click for details
Installing IBE requires the existence of both GMP and PBC libraries.-
$ sudo apt install libgmp3-dev $ sudo apt install libssl-dev -
$ sudo apt install libssl-dev -
$ wget https://crypto.stanford.edu/pbc/files/pbc-0.5.14.tar.gz- Install flex and bison if they are not have installed before
$ sudo apt-get install flex $ sudo apt-get install bison - Unzip the pbcXXXXX.gz file and then cd inside the unzipped folder
-
$ ./configure $ make $ sudo make install
click for details
-
Install MQTT client library
$ sudo apt install libmosquitto-dev -
Install Openssl linrary
$ sudo apt-get install libssl-dev
click for details
- You need to compile the KeyNote trust management library before running the Policy Evaluation Module on the RPI. Otherwise, the authorized subscribers will not get the secret shares from the KeyStroes. To compile the library, you need to change the directory to the KeyStore/KeyNote/ folder and then run make. You can read more about using the KeyNote trust management system and the changes that we have implemented on here.
$ cd KeyStore/Keynote
$ make
click for details
- Compile and run KeyStore: the ID of the KyeStore must be provided.
$ cd KeyStore/KS
$ make
$./KeyStore ID1 ibe sss
- Then, compile and run the Policy Evalaution Module (the ID here is the same one used while running the KeyStore)
$ cd KeyStore/KSPEM
$ make
$./PEM ID port1
- To compile and run the Subscriber component, you need to install the MQTT client and OpenSSL libraries (we have already discussed how to install these libraries in the KeyStore section).
- Some paprmerts (in config.h and subscriber.h) need to be adjusted before compiling and runiing the subscribers. These papramerts are:
KSN_NUM // The number of KeyStores.
SSS_T // Shamir's secret sharing threshold. this should be consistent with the parameter selected in the publisher
KSids[KSN_NUM] = {ID1, ID2, ...} // The IDs of KeyStres. This should include the IDs that were used during running every KeyStores
KSports[KSN_NUM] = {port1, port2, ...} // The ports where every Policy Evaluation Module is listening
KSnames[KSN_NUM] = {IP1, IP2, ...} // The IP address of the KSN_NUM KeyStores
The folder **Subscriber/cre** should include all the required credentials (except the one that will be received from the publisher), the subscriber's public key, and the asserts file
- Then, compile and run Subscriber as follows:
$ cd Subscriber
$ make
$./Subscriber
We use the Mosquitto as our MQTT broker. Run command to install the Mosquitto on your device.
sudo apt-get update
sudo apt-get install mosquittoThe mosquitto broker should be successfully installed and started now. Run command to check mosquitto broker status.
service mosquitto status
See LICENSE for more details.