Moving to bw_projects needs a migration

[cmutel]

We need to read the old database file (probably using the builtin library and not peewee as we aren't sure about the schema) and insert the old projects into the new database.

[cmutel]

bw_projects uses the same database file, projects.bd, but different tables. The older version is called projectdataset, the bw_projects one is project:

[cmutel]

Code to get old values from SQLite database:

import pickle
import sqlite3


def process_value(data, column):
    if column == 'data':
        return pickle.loads(data)
    else:
        return data


def load_old_project_data():
    projects_db_fp = bd.projects.file_helper.dir_base_data / "projects.db"
    projects_db = sqlite3.connect(projects_db_fp)
    cursor = projects_db.cursor()

    columns = [line[0] for line in cursor.execute("SELECT name FROM pragma_table_info('projectdataset') ORDER BY cid ASC")]
    qs = list(cursor.execute("SELECT * FROM projectdataset"))

    return [
        {column: process_value(value, column) for column, value in zip(columns, line)}
        for line in qs
    ]