Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WIP: pickle shelffile -> standard_address_space.sql #763

Open
wants to merge 19 commits into
base: master
Choose a base branch
from
Open

WIP: pickle shelffile -> standard_address_space.sql #763

wants to merge 19 commits into from

Commits on Dec 17, 2019

  1. pickle shelffile -> standard_address_space.sql 

    Refactoring the shelffile from a monolithic blob to sqlite3 db.
Advantages over pickle:
- Fast
- Small (25% of fill_address_space code)
- Not dependent on Python2/3 version
- Supports transactional read/(write TODO)
- Supports real-time persistence of user address-space (TODO)
- Strong typed: only INTEGER, TEXT and opc-ua to_binary() BLOB
- Drop-in replacement for memory-based AddressSpace

Built-in integrity check on generate_address_space.py dump.
    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    8366780 View commit details
    Browse the repository at this point in the history

  2. Nested address spaces

    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    cbb9783 View commit details
    Browse the repository at this point in the history

  3. realtime database updates

    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    32184eb View commit details
    Browse the repository at this point in the history

  4. updated gitignore to include standard_address_space.sql

    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    9b8fa89 View commit details
    Browse the repository at this point in the history

  5. added StandardAddressSpaceSQLite shortcut

    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    c728fc5 View commit details
    Browse the repository at this point in the history

  6. bugfix backend -> self.backend

    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    8eb77dd View commit details
    Browse the repository at this point in the history

  7. fixed BytesWarning: Comparison between bytes and string

    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    f6c1c59 View commit details
    Browse the repository at this point in the history

  8. PEP8 _getConn -> _get_conn

    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    8bf6e78 View commit details
    Browse the repository at this point in the history

  9. table name ReferenceDescription -> References

    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    ea53097 View commit details
    Browse the repository at this point in the history

  10. added usage example

    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    036dd2d View commit details
    Browse the repository at this point in the history

  11. address_space_sqlite: Py2.7 compatibility

    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    6841e13 View commit details
    Browse the repository at this point in the history

  12. don't include standard_address_space.sql in git repo

    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    2b256a5 View commit details
    Browse the repository at this point in the history

  13. address_space_sqlite: support for String/Guid/ByteString NodeId

    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    5f5803c View commit details
    Browse the repository at this point in the history

  14. sqlite3 backend: support for immutable db when readonly fs

    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    3ecf6d6 View commit details
    Browse the repository at this point in the history

  15. Fix: sqlite3.OperationalError: database is locked 

    Multiprocessing causes locking error when write and commits
from multiple threads are interleaved. Make sure that commits
are performed under the same Lock() session.
    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    0fbcc00 View commit details
    Browse the repository at this point in the history

  16. use sqlite3 indexing for faster lookups attributes/references

    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    96caf71 View commit details
    Browse the repository at this point in the history

  17. sqlite address space: support to remove references

    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    9e2fe7e View commit details
    Browse the repository at this point in the history

  18. SQLite address space: added support to remove nodes

    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    814d69a View commit details
    Browse the repository at this point in the history

  19. generate_nodeid now generates random id's 

    Since the sqlite address-space is lazy loading,
the old approach with incremental identifiers is
very slow, as it requires loading the complete
address space in memory before the highest identifier
is found. Generating a random uid and checking if
it already exists in the address space is much faster,
especially for hunderds of nodes.
    @brubbel
    brubbel committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    6007393 View commit details
    Browse the repository at this point in the history