π A collection of C++, Python & Rust development-oriented config scripts to quickly init new machines π» for my personal use. Dotfiles are in a separate repository here: https://github.com/jan-revay/dotfiles and here: https://github.com/jan-revay/windows_dotfiles
cd ~
git clone https://github.com/jan-revay/initPC.git
cd initPC/
git checkout <branch>
(optional step, branchdevel
is the default)- Run the initPC script launcher:
./run_init.sh
- on Linux distros or TermuxSet-ExecutionPolicy unrestricted && cd Windows_10 && .\run_all.ps1
- on Windows (with administrator privileges)
βοΈ Note: Logs will appear in the folder initPC/Logs/
. Use cat <logfile>
to display the log file with the original VT100 colors.
If you have updated the initPC
or dotfiles
repo, use the:
refresh
command (an alias defined in .bash_aliases
) to apply the changes in
the repository to your machine (e.g. install added packages). Keep in
mind, that the refresh
script only adds stuff, it never removes any
packages (other than apt-get autoremove
) even if those were removed
from the initPC repo and it does not reverse already executed changes in
the machine configuration (the Nix config will be able to do that, but
it is not finished). Removing a package/config option from the initPC
script does not affect the configuration of the existing machine after
the script is executed for the first time. The refresh
script however
overwrites the old configuration options with new ones, if a particular
config option was modified (e.g. a gsettings option).
Currently, the main focus of the initPC script is a well-tuned Ubuntu 24.04 with GNOME resp. CLI, and Windows 11. Some other Debian-based distros are also supported to various degrees, but initPC scripts for other OSes/distros are not maintained as much & the support for them might be completely dropped in the future.
Yes, the refresh command should be idempotent. This is also partly verified in CI via GitHub actions (TODO make sure and improve the test).
By idempotency, we mean:
Let:
R_C1 - executing refresh resp. initPC via ./run_init.sh on a commit C1
π’ - set of all possible states of an OS image
S β π’ - clean state (state after installing a new OS before running ./run_init.sh)
β : R_Ci x π’ -> π’ - application of the `refresh` command to the state of the machine
We want:
R_C1 β (R_C1 β S) = R_C1 β S
2. Does the refresh
command (on a machine in any state) always
produce the same state as running the script on a clean new OS install
from scratch? Why not use Nix?
In general no. Only the Nix package manager can do rollbacks and updates (e.g. removing packages and configs) deterministically. It would be hard to replicate that elsewhere. However, the whole configuration of a new machine takes just around 20 minutes with the Ubuntu initPC scripts. Therefore if the state of an existing machine and the state described in this repo do diverge too much, it should be possible to reinstall the OS and reconfigure the machine from a clean state fairly quickly (TODO after the backup solution is also finished). Hence despite NixOS being more capable in this regard, it is still possible to achieve a similar practical effect using this init script. As Nix is not as widely used as Debian and Ubuntu, I have used Debian package manager as a default rather than Nix. However, I plan to implement the initPC script for Nix as well and I am also considering using Nix more in the future, for now, however, most effort is spent on tuning the Ubuntu version of the setup script.
By deterministic system configuration, we mean:
Let us have 2 commits:
C1 -> C2
And let:
R_Ci - executing refresh resp. initPC via ./run_init.sh on a commit Ci
π’ - set of all possible states of an OS image
S β π’ - clean state (state after installing a new OS before running ./run_init.sh)
β : R_Ci x π’ -> π’ - application of the `refresh` command to the state of the machine
We want:
R_C2 β (R_C1 β S) = R_C2 β S
At the moment it would just add complexity, and unnecessary dependence (e.g. it could break Termux on Android), be less flexible, and would not be as beneficial for a project of this size. Also, I don't have any experience in writing Ansible scripts... However, I might rewrite some parts of the codebase to Ansible scripts later.
Dotfiles are currently managed via a bare Git repo (home directory) and Stow (system-level configuration files). In the future, I might use Chezmoi or a more sophisticated tool for managing dotfiles & templating them, if the need arises. See: https://www.chezmoi.io/why-use-chezmoi/
devel
- development and experiments, might be inconsistent or broken regularly. Consistent, and fully functional changes from the branchdevel
might be merged into the branchtesting
. Thedevel
branch is expected to be broken from time to time (e.g. when working on larger changes "per partes" or experimenting) and it might not always be possible to init a machine using it. New changes are usually pushed to thedevel
branch directly, however, very large changes can have an individual feature branch.testing
- shouldn't be broken or inconsistent most of the time. This branch has changes fromdevel
queued to be accepted to thestable
branch (or rejected). If a change is rejected fromtesting
it will be dropped via a commit intodevel
that will be fast-forward merged to thetesting
branch again.stable
- tested, stable, useful, production-ready, and not expected to change more than a few times a year.LTS
- debloated, (also tested, stable, useful, production-ready) and not expected to change much in the yearly horizon. Only necessary stuff. Possibly useful for detecting whether bugs in thestable
branch are caused by the init script or to be used as a substitute for thestable
branch while thestable
branch has a critical bug. Debloating is done via additional commits on top of theLTS
branch, therefore syncingstable
andLTS
is done via rebasing to preserve the debloating commits on top. As theLTS
branch has additional commits on top, it is tested separately.feature-<name of the feature>
- all feature branches should be branched off and merged todevel
. Features and bugfixes oftesting
,stable
, orLTS
should always go through thedevel
branch first (following the change workflow below).archived/<branch-name>-<YYYY-MM-DD>
- branches archived before apush --force
.
LTS
, stable
, and testing
branches are expected to be always in a
consistent state so that they can always be used to init a new machine
e.g. VM or a bootable partition.
βοΈ Note: By stable I mean free of unpredictable behavior and crashes, not as described here: https://medium.com/@gordon.messmer/what-does-stable-mean-4447ac53bac8 (TODO toread)
functional & tested, stable, useful not changing, debloated,
impl. consistent** & production-ready retested & stable
O---------> devel ---------------> testing -----------------> stable -----------------> LTS
| β§ ff-only merge ff-only merge rebase
| impl. |
| |
+-----> feature-branch
large
change
** "consistent" means, among other things, that all CI tests (implemented via GitHub actions) pass successfully.
Bug reports and pull requests are welcome, if a feature is interesting but not useful for me, I will keep it in a separate branch, I might change my mind later :D . Issues and feature requests can be created here: https://github.com/jan-revay/initPC/issues
- Merge and deprecate the InitNewPC repo InitPC repo on org GitHub and initAndroid repo.
- Merge with LogidCfg repo
- Test the Windows setup script on a VM
- Create aliases for PowerShelly
- Try merging the apt, flatpak, and snap install commands
- Have a look at popOS packages and add the useful ones to other init scripts
- Design a system for applying the configs on all my machines once they
are updated here.
- implement
refresh
alias (with CI idempotency tests) - add notification to .bashrc if the initPC or dotfiles are not up to date
- implement
- Add more C++ tools from here: https://github.com/cpp-best-practices/cppbestpractices/blob/master/02-Use_the_Tools_Available.md
- Add Bats automated tests
- Try adding NixOS
- Create CI tests on GitHub
- Todos from the repo
- Make the core Linux init script Debian-based (i.e. other distros just add stuff to the Debian base init script)
- Consider replacing the Debian variants (Ubuntu, PopOS...) with a single Ansible script with conditionals.
- Do some research on whether snap and flatpak packages work in WSL resp. which alternative package manager to use in WSL
- Consider running the whole
./run_all.sh
script as sudo and removingsudo
commands from the script. - Consider using http://www.bashbooster.net/, https://github.com/bevry/dorothy, https://www.chezmoi.io/ or similar libraries (see: https://www.chezmoi.io/comparison-table/ and https://dotfiles.github.io/utilities/).
- Format to max 82 chars in a line.
- Echo errors to stderr
- Make the script compliant with the Google Bash style guide.
- Consider running different files in different subshells i.e. not
using the
source
command. - shared_gui_packages_install.sh
- Automatic formatting of markdown files
- Format markdown files (add linebreaks, beautify...)
- Consolidate branches (unmerged feature branches).
- Backup solution
- Consider using https://canonical-ubuntu-wsl.readthedocs-hosted.com/en/latest/tutorials/cloud-init/
- Why does the pre-commit hook (ShellCheck) fail locally but succeed in CI?
- Add functional tests (see GitHub runners or ThePrimagen scripts as an example.)
- Try to replicate my current MX3 master setup (high-res scrolling turned off) with just the logid driver, if possible.
- Add Sway init and config files
- Install VSC as .deb pkg & add config according to https://code.visualstudio.com/docs/setup/linux
- Fix CI (stow logid.cfg)
- Set up logid mouse
- Automatic updates of Flatpaks and Snaps
- Merge with my old initPC-like repos (private), compare gsettings scripts with my old dconf dumps (backup_config repo)
- Put packages equivalent to windows ones to Linux init script
- Consider using ZFS or BTRFS for /home partition (or parts of the home dir)
- https://gist.github.com/saurabhnanda/6720c13fe02c4ffd950c80f41091e199
- https://www.quora.com/Which-format-is-faster-ZFS-or-Ext4
- https://www.phoronix.com/review/ubuntu1910-ext4-zfs
- https://medium.com/@rebrovadim/my-home-server-file-system-test-ext4-vs-zfs-spoiler-its-not-what-i-expected-e5e5802cbb66
- https://www.pitsdatarecovery.net/blog/zfs-vs-ext4/
- https://www.cbtnuggets.com/blog/technology/system-admin/linux-file-systems-ext4-vs-btrfs-vs-zfs
- https://www.reddit.com/r/linux/comments/yrlljv/zfs_vs_btrfs_in_2022/
- remap CapsLock to sth more useful
- https://gist.github.com/nat-418/135a62fb9f37cc87cd70af1ab72e276a
- https://superuser.com/questions/1678792/how-do-i-remap-cap-lock-to-make-other-keys-act-different
- https://stackoverflow.com/questions/72450298/use-hyper-key-in-gnome-shortcuts (last post)
- https://chatgpt.com/share/a4235ba1-74e9-4dc4-804a-44c03b610ce3
- a more ergonomic layout for programming (mainly for symbols)
- keyboard shortcuts
- https://wiki.archlinux.org/title/Xorg/Keyboard_configuration
- https://www.x.org/releases/current/doc/xorg-docs/input/XKB-Config.html
- https://www.charvolant.org/doug/xkb/html/node5.html#SECTION00054000000000000000