Commit graph

475 commits

Author SHA1 Message Date
bunnie
3ca8f669a3 breaking change in svd2utra: fix deprecation of quick-xml
quick-xml 0.19.0, a dependency of svd2utra, uses features
that Rust will deprecate.

Unfortunately, the only versions of quick-xml that do not
use the deprecated language features also break a portion
of the API. In particular, quick-xml will no longer take
a `File` as an input: it will only take a `Path`.

This means that the API for svd2utra is also broken, because
originally it was designed to take a `File`

This patch refactors svd2utra to work with the latest quick-xml,
but also breaks any code that calls svd2utra's generate
APIs.

Fortunately this is fairly easy to fix, the calling code
will typically already have the Path somewhere in it, so
instead of opening the Path and passing it into the function,
one may simply pass in the Path.
2023-04-04 02:03:35 +08:00
eupn
8694eaa004
elf.rs: fix alignment edge case (take 2) 2023-03-27 18:41:45 +04:00
eupn
199ab0a73c
elf: fix a section alignment edge case 2023-03-27 16:29:07 +04:00
bunnie
704aaf98af bump versions for kernel interface changes 2023-03-22 02:48:55 +08:00
bunnie
303f595d6f bump versions to cleanup renode.rs sync issue 2023-03-14 16:34:53 +08:00
bunnie
da4c775113 fix backup and restore to be compatible with new SoC format 2023-03-10 00:56:28 +08:00
bunnie
e8275d4009 update tools to work with a debug-less SoC
it will automatically determine which reset/halt approach
should be used based on the available registers.
2023-03-10 00:02:53 +08:00
bunnie
b68e7cb03a bump version number of updater so it can be pushed 2023-03-09 04:07:25 +08:00
bunnie
f73b9cff84 clarify the reboot instructions to wait for auto actions to complete 2023-03-09 04:05:33 +08:00
bunnie
82e3aa322f bump toml files in prep for publish 2023-03-08 03:54:37 +08:00
bunnie
08ae66a264 fix: #320
this commit adds the facilities to extract eh_frame[_header]
sections and pass it to each process.

A bump is required to `std` to extract the passed parameters.
2023-02-15 19:55:08 +08:00
bunnie
43c73c0d6c align sections of the MiniElf
Sections of the MiniElf are now aligned as required by the
source ELF requirements. This is required for direct-mapping
with XIP.

the overhead is just a few bytes every couple of programs, so it's
a small price to pay for XIP.
2023-02-12 01:13:30 +08:00
bunnie
68c9865072 fix the assumption about all alignments being identical
figured out a way to modify the trait so that alignments
are 0 by default, and only set/reported for IniF,
on a per-process basis so if for some reason the alignments
change we should be OK.
2023-02-08 04:57:52 +08:00
bunnie
29f050a8ad fix alignment for IniF region so page mappings are 1:1
Turns out, the pointing end of the stick for ELF sections don't start
at a page boundary. For example:

5    IniF: entrypoint @ 0001e42e, loaded from 000440f4.  Sections:
    Loaded from 000440f4 - Section .rodata        16924 bytes loading into 000100f4..00014310 flags: NONE
    Loaded from 00048310 - Section .eh_frame_hdr   1772 bytes loading into 00014310..000149fc flags: NONE
    Loaded from 000489fc - Section .eh_frame       6004 bytes loading into 000149fc..00016170 flags: NONE
    Loaded from 0004a170 - Section .text          59876 bytes loading into 00017170..00025b54 flags: EXECUTE
    Loaded from 00058b54 - Section .sdata            48 bytes loading into 00026b54..00026b84 flags: WRITE
    Loaded from 00058b84 - Section .sbss             48 bytes loading into 00026b84..00026bb4 flags: WRITE | NOCOPY
    Loaded from 00058bb4 - Section .bss             516 bytes loading into 00026bb8..00026dbc flags: WRITE | NOCOPY

Here you can see, the data is "loading into" 0x100f4, not
0x10000. The original PR would align things to a page, which means
you'd still have an offset mismatch if you tried to map these directly
over.

This patch causes IniF to insert extra padding to target
the offset necessary for the MiniElf to map 1:1.

An important assumption is the offset is constant across all
programs being linked. This seems to be the case, but, if this
assumption breaks, then the padding will also break.
2023-02-08 04:47:29 +08:00
bunnie
9889856ede page-align processes within the kernel image 2023-02-07 21:10:23 +08:00
bunnie
fbae0f31f4 fix backup checking without passwords 2023-02-06 16:56:18 +08:00
bunnie
41a34ffda0 bump release URL list in restore script 2023-02-06 16:00:18 +08:00
bunnie
9256e7cc09 bump versions to absorb xous-names fix 2023-01-31 15:07:32 +08:00
bunnie
84368c3f3a bump versions for publication 2023-01-31 02:18:12 +08:00
bunnie
a3086357bd make backup timestamps windows-compatible 2023-01-27 14:19:41 +08:00
bunnie
232a4b6c6c bump xous version 2023-01-18 00:02:46 +08:00
bunnie
c67a32b28c v2p table shouldn't be in the index
this is a temporary file related to performance profiling. added to .gitignore.
2023-01-13 03:01:39 +08:00
bunnie
c631963a4b Merge branch 'feat/usb-mass-storage' of github.com:gsora/xous-core into gsora-feat/usb-mass-storage 2023-01-13 02:59:17 +08:00
bunnie
02ffa530f6 remove unused test routine 2023-01-06 00:45:20 +08:00
bunnie
df9d7b4eb0 try once again to lean up the dependency tree for usb_update.py 2023-01-06 00:45:05 +08:00
bunnie
8ff492914b remove bip_utils dependency from usb_update.py 2023-01-05 23:47:53 +08:00
bunnie
7b2bfcb247 fix #291: give backups a default name that includes a timestamp
this prevents backups from being overwritten by accident.
2023-01-05 14:26:43 +08:00
bunnie
bb5d7b3adf bump versions to absorb hosted mode fix 2023-01-05 14:07:24 +08:00
bunnie
521b75639e remove bip_utils dependency from precursorupdater
this allows precursorupdater to run on older platforms that
don't support the very latest greatest pythons

instead we have a hand-rolled bip-39 implementation that we're using.

Python.  ¯\_(ツ)_/¯
2023-01-03 03:46:55 +08:00
bunnie
020b755023 eliminate bip_utils package dependency
bip_utils is not sufficiently compatible with enough platforms
to be worth integrating. we use a hand-rolled bip-39 implementation
instead to eliminate the dependency.
2023-01-03 03:44:50 +08:00
Gianguido Sorà
46ca14e2f9
Squashed commit of the following:
commit a09100ab4a
Author: bunnie <bunnie@kosagi.com>
Date:   Fri Dec 30 15:55:55 2022 +0800

    bump lockfile

commit 53172e1471
Author: bunnie <bunnie@kosagi.com>
Date:   Fri Dec 30 15:46:40 2022 +0800

    bump verification pins

commit 36398810dd
Author: bunnie <bunnie@kosagi.com>
Date:   Fri Dec 30 15:24:36 2022 +0800

    bump version numbers to absorb new syscalls

commit 062fa6178a
Merge: ac4a854e 3bcc955a
Author: bunnie <bunnie@kosagi.com>
Date:   Fri Dec 30 15:23:31 2022 +0800

    Merge branch 'reply-and-receive-next-syscall' into main

commit ac4a854e49
Merge: d1375343 e4c298db
Author: bunnie <bunnie@kosagi.com>
Date:   Fri Dec 30 15:22:25 2022 +0800

    Merge branch 'main' of github.com:betrusted-io/xous-core into main

commit 3bcc955aba
Author: bunnie <bunnie@kosagi.com>
Date:   Fri Dec 30 15:21:43 2022 +0800

    add test code that also benchmarks the new routines.

commit e4c298db40
Merge: f71278b4 e2bf7109
Author: bunnie <bunnie@kosagi.com>
Date:   Fri Dec 30 15:16:13 2022 +0800

    Merge pull request #289 from betrusted-io/reply-and-receive-next-syscall

    Reply and receive next syscall

commit e2bf710939
Author: Sean Cross <sean@xobs.io>
Date:   Thu Dec 29 21:06:51 2022 +0800

    services: xous-ticktimer: use reply_and_receive_next()

    Convert the ticktimer server to use the new
    reply_and_receive_next_legacy() call. This is an example of how to use
    this API for future projects.

    Signed-off-by: Sean Cross <sean@xobs.io>

commit 0e75b8e479
Author: Sean Cross <sean@xobs.io>
Date:   Thu Dec 29 21:05:26 2022 +0800

    test-spawn: rename `Message` to `MessageEnvelope`

    Signed-off-by: Sean Cross <sean@xobs.io>

commit 3218bde2b4
Author: Sean Cross <sean@xobs.io>
Date:   Thu Dec 29 21:04:01 2022 +0800

    kernel: implement reply_and_receive_next

    Implement `ReplyAndReceiveNext` as a syscall. This will reply to a
    message, pull the next message out of the queue, and then re-queue the
    server to run. This should make servers much more responsive.

    This patch has been tested on both hosted and native modes.

    Signed-off-by: Sean Cross <sean@xobs.io>

commit d1375343c1
Author: bunnie <bunnie@kosagi.com>
Date:   Thu Dec 29 23:34:48 2022 +0800

    update release notes

commit f71278b422
Author: bunnie <bunnie@kosagi.com>
Date:   Thu Dec 29 22:04:55 2022 +0800

    fix issue #109 - refactor key fill/scan to not crash after pruning

    After a prune, key fill/scan can crash because there is an assumption
    that data is always resident in the cache for a small key.

    This code handles the case where the small key data was evicted during
    a prune, and reads the data back in just for that key on demand.

    Furthermore, during a `sync` call, it will pull in the key data
    that corresponds to the page containing just the small key, allowing
    that page to be re-composed and replaced in memory. caching is used
    on the decryption of the small key page so the expensive bit
    of the call should only happen once per small key bank.

    tested with pddb-ci and manually in hosted mode.

    A portion of code was re-written to make it clear that only the
    length of allocated data is copied to/from disk and memory, instead
    of the reserved space as the previous code would indicate. The reserved
    space is guaranteed to be zero because the RAM-based page for composing
    the small key block is zero-ized prior to operations; left comments
    reminding me of this in the future so I don't accidentally optimize
    something out and cause data leakage between small keys because I'm
    allowing the reserved areas to contain stale data.

commit e25da3a720
Author: bunnie <bunnie@kosagi.com>
Date:   Thu Dec 29 22:04:15 2022 +0800

    add implemenation of the `prune` debug call

    this allows us to trigger the cache prune manually, instead of
    in response to memory backpressure only

commit 549e67fead
Author: bunnie <bunnie@kosagi.com>
Date:   Thu Dec 29 22:03:19 2022 +0800

    add a `prune` debug call to force a hard-prune of the pddb cache

commit e045574d39
Author: Sean Cross <sean@xobs.io>
Date:   Thu Dec 29 21:06:51 2022 +0800

    services: xous-ticktimer: use reply_and_receive_next()

    Convert the ticktimer server to use the new
    reply_and_receive_next_legacy() call. This is an example of how to use
    this API for future projects.

    Signed-off-by: Sean Cross <sean@xobs.io>

commit 23c17d7632
Author: Sean Cross <sean@xobs.io>
Date:   Thu Dec 29 21:05:26 2022 +0800

    test-spawn: rename `Message` to `MessageEnvelope`

    Signed-off-by: Sean Cross <sean@xobs.io>

commit aae5f3737c
Author: Sean Cross <sean@xobs.io>
Date:   Thu Dec 29 21:04:01 2022 +0800

    kernel: implement reply_and_receive_next

    Implement `ReplyAndReceiveNext` as a syscall. This will reply to a
    message, pull the next message out of the queue, and then re-queue the
    server to run. This should make servers much more responsive.

    This patch has been tested on both hosted and native modes.

    Signed-off-by: Sean Cross <sean@xobs.io>

commit ab0c7d3b32
Author: Sean Cross <sean@xobs.io>
Date:   Thu Dec 29 21:03:39 2022 +0800

    kernel: server: check buf is some when returning mem

    Signed-off-by: Sean Cross <sean@xobs.io>

commit 46f340324d
Author: Sean Cross <sean@xobs.io>
Date:   Thu Dec 29 21:02:57 2022 +0800

    kernel: rename `Message` -> `MessageEnvelope`

    This syncs with the latest changes to `xous-rs`.

    Signed-off-by: Sean Cross <sean@xobs.io>

commit 911ddb60fc
Author: Sean Cross <sean@xobs.io>
Date:   Thu Dec 29 21:01:27 2022 +0800

    kernel: debug: fix klog on baremetal

    klog() refers to an outdated `.uart` struct, which has since been
    renamed to `.serial`.

    Signed-off-by: Sean Cross <sean@xobs.io>

commit d88254b1b1
Author: Sean Cross <sean@xobs.io>
Date:   Thu Dec 29 21:00:35 2022 +0800

    xous: add reply_and_receive_next_legacy call

    This call is used to return values while simultaneously listening for
    new messages.

    The -legacy suffix is used to disambiguate scalar values, so we know
    whether to send Scalar1, Scalar2, or Scalar5 messages.

    Signed-off-by: Sean Cross <sean@xobs.io>

commit 64c88f9942
Author: Sean Cross <sean@xobs.io>
Date:   Thu Dec 29 21:00:05 2022 +0800

    xous: add Message type

    This type actually contains the message contents, and will be used to
    return data to the caller.

    Signed-off-by: Sean Cross <sean@xobs.io>

commit d463f9563f
Author: Sean Cross <sean@xobs.io>
Date:   Thu Dec 29 20:58:51 2022 +0800

    xous: rename Message to MessageEnvelope

    This reflects the fact that up until now, the `Message` struct has
    merely been the envelope that surrounds the message. It does not contain
    any actual Message contents.

    Signed-off-by: Sean Cross <sean@xobs.io>

commit 49ce85f9a8
Author: Sean Cross <sean@xobs.io>
Date:   Wed Jul 6 15:57:10 2022 +0800

    ticktimer-server: prepare for using ReplyAndReceiveNext

    Misc cleanup prior to switching which call we use.

    Signed-off-by: Sean Cross <sean@xobs.io>

commit be56af6303
Author: Sean Cross <sean@xobs.io>
Date:   Wed Jul 6 15:35:22 2022 +0800

    xous: add wrapper for reply_and_receive_next

    This wrapper enables userspace programs to use the new
    ReplyAndReceiveNext syscall easily.

    Signed-off-by: Sean Cross <sean@xobs.io>

commit 36e6e6c30b
Author: Sean Cross <sean@xobs.io>
Date:   Wed Jul 6 15:18:32 2022 +0800

    xous: syscall: add ReplyAndReceiveNext call

    Signed-off-by: Sean Cross <sean@xobs.io>

commit 1e56598b10
Author: bunnie <bunnie@kosagi.com>
Date:   Thu Dec 29 00:53:32 2022 +0800

    chore: fix some typos

commit 1291b0f00b
Author: bunnie <bunnie@kosagi.com>
Date:   Thu Dec 29 00:38:27 2022 +0800

    add issue # to release note

commit 7206f24271
Author: bunnie <bunnie@kosagi.com>
Date:   Thu Dec 29 00:37:47 2022 +0800

    update release notes

commit 2f30e1b50a
Author: bunnie <bunnie@kosagi.com>
Date:   Thu Dec 29 00:11:03 2022 +0800

    implement #269

commit 5370c333da
Author: bunnie <bunnie@kosagi.com>
Date:   Thu Dec 29 00:10:42 2022 +0800

    add callback for monitoring basis lock/unlock events

commit 8d42feb051
Author: bunnie <bunnie@kosagi.com>
Date:   Wed Dec 28 19:48:40 2022 +0800

    increase heap for mtxcli; add memory usage reporting

commit ac1df054ab
Author: bunnie <bunnie@kosagi.com>
Date:   Mon Dec 26 13:52:44 2022 +0800

    absorb 22-bit satp fix

commit 89500015a7
Author: bunnie <bunnie@kosagi.com>
Date:   Thu Dec 15 17:52:55 2022 +0800

    try to fix regression from #284

    still hitting cache coherence edge cases. expanding the flush
    set read by one more way.

commit 41ea0a37c5
Merge: e422740d b288d93a
Author: bunnie <bunnie@kosagi.com>
Date:   Thu Dec 15 14:36:40 2022 +0800

    Merge branch 'main' of github.com:betrusted-io/xous-core into main

commit b288d93abd
Merge: 8e1d0502 d4527b82
Author: bunnie <bunnie@kosagi.com>
Date:   Thu Dec 15 14:00:10 2022 +0800

    Merge pull request #284 from betrusted-io/use-thin-lto

    cargo: use thin-lto

commit d4527b8227
Author: Sean Cross <sean@xobs.io>
Date:   Thu Dec 15 12:26:00 2022 +0800

    cargo: use thin-lto

    Use thin LTO for linking. This shouldn't have too big of an affect on
    the resulting binary size, and it fixes the build for 1.66.0:

    = note: rust-lld: error: undefined symbol:
    core::panicking::panic_str_nounwind::h9b449c0fe03c8dac
    >>> referenced by compiler_builtins.22a3dcb1-cgu.13
    >>> compiler_builtins-b913bacb8fda1c55.compiler_builtins.22a3dcb1-cgu.13.rcgu.o:(compiler_builtins::math::libm::rem_pio2_large::rem_pio2_large::h3db6431f23a281c1)
    in archive root\lib\rustlib\riscv32imac-unknown-xous-elf\lib\libcompiler_builtins-b913bacb8fda1c55.rlib
    >>> referenced by compiler_builtins.22a3dcb1-cgu.13
    >>> compiler_builtins-b913bacb8fda1c55.compiler_builtins.22a3dcb1-cgu.13.rcgu.o:(compiler_builtins::math::libm::rem_pio2_large::rem_pio2_large::h3db6431f23a281c1)
    in archive root\lib\rustlib\riscv32imac-unknown-xous-elf\lib\libcompiler_builtins-b913bacb8fda1c55.rlib

    Signed-off-by: Sean Cross <sean@xobs.io>

commit e422740d37
Author: bunnie <bunnie@kosagi.com>
Date:   Tue Dec 13 23:03:50 2022 +0800

    chore: last one. really.

commit ad79ebf8ba
Author: bunnie <bunnie@kosagi.com>
Date:   Tue Dec 13 23:02:09 2022 +0800

    chore: more typos. no really, i can stop at any time.

commit b1b6d46d27
Author: bunnie <bunnie@kosagi.com>
Date:   Tue Dec 13 22:56:37 2022 +0800

    chore: more typos

    probably should not have tried to spell check this, now i'm wasting
    my time.

commit 283ea1de0d
Author: bunnie <bunnie@kosagi.com>
Date:   Tue Dec 13 22:49:25 2022 +0800

    chore: fix more typos, add french dictionary to vscode workspace settings

commit 1d94968b2f
Author: bunnie <bunnie@kosagi.com>
Date:   Tue Dec 13 22:36:47 2022 +0800

    chore: fix typos

commit e930d88563
Author: bunnie <bunnie@kosagi.com>
Date:   Tue Dec 13 01:42:00 2022 +0800

    placeholder for 0.9.12 release notes

commit 8e1d05020d
Author: bunnie <bunnie@kosagi.com>
Date:   Tue Dec 13 00:32:11 2022 +0800

    add v0.9.11 to the restore.py URL list

commit bd230f5bb0
Author: bunnie <bunnie@kosagi.com>
Date:   Mon Dec 12 16:51:27 2022 +0800

    fix text to speech mode preferences setting

    never allow the audio system to be turned off for blind people,
    and disallow 0-volume setting as well.

commit 38bc254bb9
Author: bunnie <bunnie@kosagi.com>
Date:   Mon Dec 12 16:28:33 2022 +0800

    fix missing ja/zh translation

commit 60d4482ce2
Author: bunnie <bunnie@kosagi.com>
Date:   Mon Dec 12 16:16:04 2022 +0800

    bump lockfile

commit 56f0843229
Author: bunnie <bunnie@kosagi.com>
Date:   Mon Dec 12 16:08:28 2022 +0800

    bump verifier numbers

commit 5370ce396d
Author: bunnie <bunnie@kosagi.com>
Date:   Mon Dec 12 16:07:20 2022 +0800

    bump all revs due to SoC artifact update

commit cac0e57cda
Author: bunnie <bunnie@kosagi.com>
Date:   Mon Dec 12 16:06:31 2022 +0800

    change default target

commit 04b441a234
Author: bunnie <bunnie@kosagi.com>
Date:   Mon Dec 12 16:06:19 2022 +0800

    add 0.9.11 build artifact

commit 08cf863ff5
Author: bunnie <bunnie@kosagi.com>
Date:   Mon Dec 12 16:05:15 2022 +0800

    update SoC artifacts for 0.9.11 build

commit c32b5d5bac
Author: bunnie <bunnie@kosagi.com>
Date:   Mon Dec 12 15:31:15 2022 +0800

    bump release notes

commit 80ce119c95
Author: bunnie <bunnie@kosagi.com>
Date:   Mon Dec 12 15:31:06 2022 +0800

    fix RSSI calculations

commit edf24d9fc2
Author: bunnie <bunnie@kosagi.com>
Date:   Mon Dec 12 14:11:19 2022 +0800

    clean up on the wifi signal bars

commit eb17edc4ec
Merge: 9a580070 435a6ea2
Author: bunnie <bunnie@kosagi.com>
Date:   Mon Dec 12 11:47:18 2022 +0800

    Merge pull request #283 from gsora/feat/wifi-signal-bars

    feat: wifi signal bar

commit 9a580070a3
Author: bunnie <bunnie@kosagi.com>
Date:   Sun Dec 11 17:50:51 2022 +0800

    revert threaded init question now that deface issue is fixed

commit f9cdf31857
Author: bunnie <bunnie@kosagi.com>
Date:   Sun Dec 11 17:07:29 2022 +0800

    bump release notes

commit 196ceb0d29
Author: bunnie <bunnie@kosagi.com>
Date:   Sun Dec 11 16:42:03 2022 +0800

    fix: avoid thrashing when recomputing previously defaced canvases

    There was a dubious line that I never felt good about and today
    I found out why. By flipping every canvas to drawable before doing
    the intersection computation we also throw away the defacement state,
    so previously defaced canvases would lose their status bit, causing
    thrashing of the canvases anytime there is a re-computation of
    the canvas ordering.

    This fix caches if a canvas was already defaced, and if it turns out
    that an on-screen canvas should not be drawable but was already
    defaced, the setting is re-applied, preventing thrashing.

commit dca043d387
Author: bunnie <bunnie@kosagi.com>
Date:   Sun Dec 11 16:41:53 2022 +0800

    improve context swap debug messages

commit 8d8dd2bd2f
Author: bunnie <bunnie@kosagi.com>
Date:   Sun Dec 11 16:41:25 2022 +0800

    fix typo in unwrap message

commit f31afa5125
Author: bunnie <bunnie@kosagi.com>
Date:   Sun Dec 11 16:41:06 2022 +0800

    remove unused opcode in shellchat; improve debug output

commit 6138b65d76
Author: bunnie <bunnie@kosagi.com>
Date:   Sat Dec 10 23:44:18 2022 +0800

    update comments to reflect changes in CI infra

commit 399124f942
Author: bunnie <bunnie@kosagi.com>
Date:   Sat Dec 10 22:05:47 2022 +0800

    fix hosted mode

commit 939e13950d
Author: bunnie <bunnie@kosagi.com>
Date:   Sat Dec 10 18:59:55 2022 +0800

    comment out debug in rootkeys implementation section

commit 2097afc166
Author: bunnie <bunnie@kosagi.com>
Date:   Sat Dec 10 18:58:06 2022 +0800

    add efuse burning flow to rootkeys

    currently only available for builds that have the `efuse` feature
    enabled

commit 19e16aea29
Author: bunnie <bunnie@kosagi.com>
Date:   Sat Dec 10 18:56:59 2022 +0800

    fix jtag fuse burning & add diagnostic messages

    - msb/lsb swap on efuse bank fixed
    - hazardous-debug feauter gates added
    - dry-run for "testing only" added

commit 4ec866e1d7
Author: bunnie <bunnie@kosagi.com>
Date:   Sat Dec 10 18:56:12 2022 +0800

    add diagnostic seal command

commit f5c687a524
Author: bunnie <bunnie@kosagi.com>
Date:   Sat Dec 10 17:45:30 2022 +0800

    clarify user prompt

commit 2b4e47384e
Author: bunnie <bunnie@kosagi.com>
Date:   Sat Dec 10 17:44:54 2022 +0800

    add fused device support and warnings to precursorupdater

commit e42c4c7b33
Author: bunnie <bunnie@kosagi.com>
Date:   Sat Dec 10 16:39:14 2022 +0800

    add warnings & support for fused devices

    burning a generic image to a fused device will surely lead to
    a brick, so, try to keep a user from shooting themselves in the foot.

commit c2f7a63f97
Author: bunnie <bunnie@kosagi.com>
Date:   Sat Dec 10 16:39:01 2022 +0800

    remove some whitespace to allow for easier debugging

commit 1f89843122
Author: bunnie <bunnie@kosagi.com>
Date:   Fri Dec 9 12:38:53 2022 +0800

    defer init root keys question until status thread starts

    also defer the preference thread from loading until after the
    PDDB mount thread is started -- doesn't make sense to start it
    any earlier than that, since it depends on the PDDB being mounted.

commit 02f9701546
Author: bunnie <bunnie@kosagi.com>
Date:   Thu Dec 8 17:42:12 2022 +0800

    make an explicit dvt feature to simplify flags

commit 4dd983bfc4
Author: bunnie <bunnie@kosagi.com>
Date:   Thu Dec 8 17:19:05 2022 +0800

    adjust security parameters for dvt build

commit fc08c3e29d
Author: bunnie <bunnie@kosagi.com>
Date:   Thu Dec 8 17:14:47 2022 +0800

    add hazardous-debug to modals bip-39

    for convenient key printout during debug. flag is normally off.

commit dd82b7f32a
Author: bunnie <bunnie@kosagi.com>
Date:   Thu Dec 8 17:14:21 2022 +0800

    add no-codec mode to status

    this is for DVT builds where the codec isn't supported, needed
    for efuse testing

commit a5d341c7a6
Author: bunnie <bunnie@kosagi.com>
Date:   Thu Dec 8 14:09:36 2022 +0800

    add a bitstream encryption/recovery tool for fused devices

    This is useful for recovering bricked devices where the backup
    key is available. This tool can be used to generate an FPGA
    image for a device that has been permanently fused to a non-0
    backup key.

commit 4f270f54be
Author: bunnie <bunnie@kosagi.com>
Date:   Wed Dec 7 22:24:56 2022 +0800

    revert debugging on status opcodes

commit 435a6ea2bd
Author: Gianguido Sorà <me@gsora.xyz>
Date:   Wed Dec 7 14:28:07 2022 +0100

    feat: wifi signal bar

    This commit draws a Wi-Fi signal bar with 5 bars (lowest to highest signal), to the right of SSID name.

    Signal power is calculated from a lowest of -90dBm to a maximum of -30dBm, by increments of 13dBm.

commit f84a9d10c7
Author: bunnie <bunnie@kosagi.com>
Date:   Sun Dec 4 18:13:37 2022 +0800

    add placeholder for the efuse flow in the rootkey service

commit 8208a86c08
Author: bunnie <bunnie@kosagi.com>
Date:   Sun Dec 4 18:12:30 2022 +0800

    add the UX front-end for backup key burning

    - instructions for BBRAM flow (refers to wiki)
    - consent for efuse flow
    - fix a blocking issue on backup prep (minor problem, just gives
    users more time to contemplate without a panic)

commit 3838f3bc15
Author: bunnie <bunnie@kosagi.com>
Date:   Sun Dec 4 18:12:05 2022 +0800

    add a pause for context swaps on menu release

commit 53c9af1033
Author: bunnie <bunnie@kosagi.com>
Date:   Fri Dec 2 23:00:38 2022 +0800

    bump readme's
2023-01-02 15:51:45 +01:00
bunnie
36398810dd bump version numbers to absorb new syscalls 2022-12-30 15:24:36 +08:00
bunnie
ad79ebf8ba chore: more typos. no really, i can stop at any time. 2022-12-13 23:02:09 +08:00
bunnie
1d94968b2f chore: fix typos 2022-12-13 22:36:47 +08:00
bunnie
8e1d05020d add v0.9.11 to the restore.py URL list 2022-12-13 00:32:11 +08:00
bunnie
5370ce396d bump all revs due to SoC artifact update 2022-12-12 16:07:20 +08:00
bunnie
f5c687a524 clarify user prompt 2022-12-10 17:45:30 +08:00
bunnie
2b4e47384e add fused device support and warnings to precursorupdater 2022-12-10 17:44:54 +08:00
bunnie
e42c4c7b33 add warnings & support for fused devices
burning a generic image to a fused device will surely lead to
a brick, so, try to keep a user from shooting themselves in the foot.
2022-12-10 16:39:14 +08:00
bunnie
c2f7a63f97 remove some whitespace to allow for easier debugging 2022-12-10 16:39:01 +08:00
bunnie
a5d341c7a6 add a bitstream encryption/recovery tool for fused devices
This is useful for recovering bricked devices where the backup
key is available. This tool can be used to generate an FPGA
image for a device that has been permanently fused to a non-0
backup key.
2022-12-08 14:09:36 +08:00
bunnie
1d1b3a35b7 commit version bump 2022-11-26 10:00:44 +08:00
bunnie
908818010d fix API change in pddbcommon that impacts pddbdbg.py 2022-11-19 22:33:43 +08:00
bunnie
aa9977cc58 bump all the things because we changed utralib again 2022-11-17 22:13:40 +08:00
bunnie
dabbfd6c35 bump all the things to absorb the SoC change 2022-11-17 19:39:18 +08:00
bunnie
30583bdf07 bump versions with xous change 2022-11-06 03:48:12 +08:00
Sean Cross
f861af7620 tools: elf: fix copy-elf when gcc links program
GCC will set the text size to `0` in a certain case that `rust-lld` did
not. This causes the elf copier to add about 512 MB to the image which
it otherwise shouldn't be doing.

Add a workaround that appears to fix the issue.

Signed-off-by: Sean Cross <sean@xobs.io>
2022-11-04 12:27:13 +08:00
bunnie
01f660b04d didn't meant to check in that script 2022-11-03 21:11:58 +08:00
bunnie
6c2e86d876 add support for small-sized PDDB images plus some debugging info 2022-11-03 21:03:40 +08:00
bunnie
c91837c10b fix max dicts in analyzer scripts 2022-11-03 18:33:22 +08:00
bunnie
3bdf157f9d enhance debugging output on pddb analyzer 2022-11-03 17:22:22 +08:00
bunnie
6d2be1b6d7 add va printouts 2022-11-02 21:52:28 +08:00
bunnie
ebc0739bee fix some defaults to make the Renode path cleaner to start 2022-11-01 21:25:04 +08:00
bunnie
f738781a40 make the default pin 'a', as it is on Renode 2022-11-01 21:18:33 +08:00
bunnie
4e2d79942e upgrade pdddbg to use basis decryption routines from the common libs 2022-11-01 21:17:07 +08:00
bunnie
54e929e877 move key extraction routines to pddbcommon.py 2022-11-01 19:01:57 +08:00
bunnie
c74ceacfef add a renode mode for reading in a renode.bin 2022-10-31 22:34:10 +08:00
bunnie
fd739c2177 add fr locale to update options 2022-10-28 15:23:39 +08:00
bunnie
ba28dd8795 bump to absorb utralib straggler configs 2022-10-28 15:11:17 +08:00
bunnie
dfb10ed7f2 bump crate numbers to publish lang-fr change into xous-rs 2022-10-28 14:01:09 +08:00
Tom Marble
006a69105c
Completes the i18n_helper.py tool
Added 'fr' translation
Added *.json to .gitattributes

Signed-off-by: Tom Marble <tmarble@info9.net>
2022-10-27 16:07:05 -05:00
Tom Marble
07cb2398d8
WIP: Adds new lang 'fr' for French
Adds new Internationalization Helper tool: i18n_helper.py

Signed-off-by: Tom Marble <tmarble@info9.net>
2022-10-26 22:32:49 -05:00
Sean Cross
bad8ba5ea2 tools: sign-image: write remainder of file
During the previous port, we only wrote the first 4096 bytes. Write the
remainder of the file to the destination.

Signed-off-by: Sean Cross <sean@xobs.io>
2022-10-26 23:40:09 +08:00
Sean Cross
22de2bc614 tools: sign_image: fix utterly broken git signing
The previous approach didn't work, for unknown reasons.

Signed-off-by: Sean Cross <sean@xobs.io>
2022-10-26 22:32:24 +08:00
Sean Cross
2cf8ff12a6 tools: add make-renode-boot
This experimental tool can be used to create all-in-one images based
on precomputed file lists. It generates "test images" using just the
bare minimum number of processes.

This program includes all the keys, kernel, and initial images required
to support a simple program.

Signed-off-by: Sean Cross <sean@xobs.io>
2022-10-26 22:22:31 +08:00
Sean Cross
2382d57dd6 tools: add sign_image.rs
Signed-off-by: Sean Cross <sean@xobs.io>
2022-10-26 22:22:18 +08:00
Sean Cross
46cd5e7098 tools: elf: allow loading files from &[u8]
Instead of assuming everything is a file or a path, allow
loading ELF files from u8 slices. This will enable us to create
images with `include_bytes!()`.

Signed-off-by: Sean Cross <sean@xobs.io>
2022-10-26 22:21:24 +08:00
Sean Cross
c50314d4a8 tools: sign-image: break image signing into a library
Move the code used to sign images into its own library file. This will
enable us to use the image signing functions from other code.

Signed-off-by: Sean Cross <sean@xobs.io>
2022-10-26 22:20:33 +08:00
bunnie
0ee9ec1d80 bump version numbers for crate publication 2022-10-25 22:38:58 +08:00
Jean-Pierre De Jesus DIAZ
f5176ea380
Remove xous-rs unused features
The rationale is that xous-rs should have only architecture
specific code, e.g.: riscv, arm, x86, etc. To make other
crates that depend on it not specify the features.

This could be useful when using xous-rs with `libstd`
for example.

Signed-off-by: Jean-Pierre De Jesus DIAZ <me@jeandudey.tech>
2022-10-25 13:29:15 +02:00
bunnie
30ea893c74
Merge branch 'main' into xous-rs-os-selection 2022-10-25 17:28:33 +08:00
bunnie
d331d405ee bump version numbers for publication 2022-10-25 17:23:40 +08:00
bunnie
e04d135e83 add vault app to sources 2022-10-24 00:36:51 +08:00
bunnie
f05a879d93 add a generic performance log analysis tool 2022-10-23 23:16:56 +08:00
bunnie
9489342d4b cleanup error messages from perflib 2022-10-23 23:15:18 +08:00
bunnie
805a7d528c flip back to using remote references 2022-10-20 16:30:06 +08:00
bunnie
86d2437f03 improve formatting so section alignments are easier to debug 2022-10-20 16:14:56 +08:00
Sean Cross
ff3f307a14 tools: read-tags: call output xous_presign.img
The use of the name `args.bin` is now deprecated.

Signed-off-by: Sean Cross <sean@xobs.io>
2022-10-20 14:11:48 +08:00
bunnie
0a361cac20 bump version to 0.0.8 to asborb factory reset change 2022-10-19 04:47:55 +08:00
bunnie
76ed23010d erase staged gateware as part of --factory-reset 2022-10-19 04:44:04 +08:00
bunnie
8e05925cfa somehow the transition to local paths got missed in the merge 2022-10-18 00:39:01 +08:00
bunnie
0584ad2f2c switch to local paths to see if this helps the build 2022-10-18 00:26:56 +08:00
bunnie
4b368d71db bump versions of crates 2022-10-15 01:31:54 +08:00
bunnie
63a87ca1bc bump all the versions 2022-10-14 16:54:43 +08:00
bunnie
ff30131f43 absorb more fixes into the kernel 2022-10-13 04:08:56 +08:00
bunnie
3503965f98 bump versions to absorb xous-rs changes 2022-10-13 03:41:16 +08:00
bunnie
02b80425f5 bump xous-rs to absorb change in language specification 2022-10-10 03:07:44 +08:00
bunnie
9732ecdc18 add v0.9.10 to restore URL list 2022-10-09 23:37:48 +08:00
bunnie
01b68cbdc9 fix development roll-out process for picking a restore kernel 2022-10-09 14:18:57 +08:00
bunnie
99c6e005ad fix hosted mode 2022-10-09 02:46:24 +08:00
bunnie
6230c922ac fix backup/restore scripts 2022-10-09 02:36:48 +08:00
bunnie
8ac80f8c42 update tools to work with checksums (partial update) 2022-10-09 01:12:03 +08:00
bunnie
c33dee152d fix backup opcode setting 2022-10-08 22:20:50 +08:00
bunnie
c471ca0fbb fix overly restrictive version match on backup version 2022-10-08 15:29:37 +08:00
bunnie
a0791ff092 back out patch of the opcode change -- the backup script did that in error 2022-10-08 02:40:55 +08:00
bunnie
89d050891b fix incorrect opcode setting on backup 2022-10-08 02:40:07 +08:00
bunnie
44d3c19733 fix hash check computation and op offset 2022-10-08 02:26:00 +08:00
bunnie
42052fdcc5 fix padding on hash check in backup tools 2022-10-08 01:53:28 +08:00
bunnie
a416069002 add hash protection on the metadata header
stage is set for hash protection on the PDDB data itself.
that comes next.
2022-10-08 01:22:14 +08:00
bunnie
0f9195f305 add some sanity checks on the backup header
this tries to catch the cases that:
  - user tried to run the backup without first running "prepare backup..."
  - the USB connection is a little flakey and returning bum data

We can only inspect the plaintext portions of the header, which contains
things like protocol version numbers, time stamps, and language codes.

We use the timestamp validation heavily because it's the only field that
isn't almost always going to be a 0 or 1 when correct, which are highly
likely to be reported anyways if there's a problem with the USB link.

This does assume the user sets the time correctly on the device
doing the backup, and on the Precursor itself.
2022-10-06 00:53:52 +08:00
bunnie
3bca9de2a0 bump version numbers for xous-kernel patch
this fixes tests in CI
2022-10-05 23:51:35 +08:00
bunnie
969f93b001 cross-repo update versions from xous-rs bump 2022-10-05 18:32:44 +08:00
bunnie
776a47f4bc missed a file 2022-10-02 02:21:06 +08:00
bunnie
15bcb6328f fixup other refs 2022-09-27 03:09:41 +08:00
bunnie
3579dfdd17 update xous-ipc and xous versions 2022-09-26 16:07:35 +08:00
bunnie
796256cfb0 make usb_update.py appear only once in the tree 2022-09-19 12:44:55 +08:00
bunnie
5461a70be1 add some generated data for later review 2022-09-16 01:52:06 +08:00
bunnie
46a2d8609f add perflib modules
this library can be re-used across multiple scenarios that require
performance profiling
2022-09-16 01:48:59 +08:00
bunnie
3a893213ff update the generated images to the latest data 2022-09-16 01:47:30 +08:00
bunnie
e12f651ac4 update analysis framework to use the binary files output by the latest changes 2022-09-16 01:47:02 +08:00
bunnie
3e79e3e430 add ability to read out data based on a list of virtual sectors
This adds the `--dump` command, which requires a file that is
a copy/paste of a generated virtual to physical table. An example
of this log would look like this:

```
INFO:shellchat::cmds::net_cmd: V|P 6000d000 40799000 (services\shellchat\src\cmds\net_cmd.rs:770)
INFO:shellchat::cmds::net_cmd: V|P 6000e000 4079a000 (services\shellchat\src\cmds\net_cmd.rs:770)
INFO:shellchat::cmds::net_cmd: V|P 6000f000 4079b000 (services\shellchat\src\cmds\net_cmd.rs:770)
INFO:shellchat::cmds::net_cmd: V|P 60010000 4079c000 (services\shellchat\src\cmds\net_cmd.rs:770)
INFO:shellchat::cmds::net_cmd: V|P 60011000 4079d000 (services\shellchat\src\cmds\net_cmd.rs:770)
INFO:shellchat::cmds::net_cmd: V|P 60012000 4079e000 (services\shellchat\src\cmds\net_cmd.rs:770)
INFO:shellchat::cmds::net_cmd: V|P 60013000 4079f000 (services\shellchat\src\cmds\net_cmd.rs:770)
INFO:shellchat::cmds::net_cmd: V|P 60014000 407a0000 (services\shellchat\src\cmds\net_cmd.rs:770)
INFO:shellchat::cmds::net_cmd: V|P 60015000 407a1000 (services\shellchat\src\cmds\net_cmd.rs:770)
```

and so forth. The script can parse this raw log to create the necessary
page table mappings to read a large region of virtual memory and save
it as a contiguous chunk in a file.
2022-09-16 01:39:49 +08:00
bunnie
57291a47f2 add some sample outputs from the analysis scripts 2022-09-11 21:16:45 +08:00
bunnie
088648409e add constant time analysis script 2022-09-11 19:13:38 +08:00
bunnie
2ee0d4dfce remind myself how to update the precursorupdater
the latest docs don't work for us, so, document our method here.
Just can't figure out the .toml method of describing the project...
2022-09-09 15:39:52 +08:00
bunnie
4b72492c3e fix bug #216 2022-09-09 15:07:31 +08:00
bunnie
ca3cc711a4 Re-add usb_update.py, but with modified help to guide users
It's a bit confusing to run the wrong tool but hopefully there
are ample help messages sprinkled in this to guide the average
user to the right location.
2022-08-16 13:57:36 +08:00
bunnie
5e455b60eb add debug to backalyzer to dump encrypted private key 2022-08-12 20:10:19 +08:00
bunnie
58a8264080 fix some bugs in printing errored-out sectors
also print the sector data that errors out -- might be a bit
much at the moment but it's very helpful for immmediately
visualizing a loss-of-power event related write corruption
2022-08-06 16:00:15 +08:00
bunnie
3a5e385b9a add arg to specify file (optionally) in backup 2022-07-29 00:24:40 +08:00
bunnie
a68eb7cc73 add missing files for backalyzer; add PTE conflict resolution 2022-07-28 04:47:02 +08:00
bunnie
e2f7a75f87 improve help message 2022-07-26 03:43:31 +08:00
bunnie
6266101727 backalyzer now works with PDDB in hosted mode.
Specify file as `-f pddb-images/hosted.bin` and use `--hosted`
2022-07-26 03:42:11 +08:00
bunnie
c889f5576f cleanup backalyzer. i think it's basically ready to go now 2022-07-26 03:09:09 +08:00
bunnie
22a85ba022 working draft of backalyzer 2022-07-26 02:53:19 +08:00
bunnie
ba7532a4fe fix backup length
we were accidentally also backing up the WF200 firmware as well,
chop that off so that the analysis scripts & restore works correctly.
2022-07-26 02:52:40 +08:00
bunnie
ef29e6e504 re-org the python pddb analysis scripts
allow for elements of pddbdbg.py to be shared with the backalyzer.py
2022-07-26 00:06:16 +08:00
bunnie
494ec7c2b3 improve the basis name validator - ':' is an illegal character in a basis name. 2022-07-26 00:05:45 +08:00
bunnie
a0a51cab5c emphasize that you must reboot by using the paperclip 2022-07-23 16:23:05 +08:00
bunnie
97b13e7df3 move the OG signing tool to legacy status 2022-07-23 16:08:47 +08:00
bunnie
b4a784391d clean up the tools directory 2022-07-23 16:07:33 +08:00
bunnie
c43aa7f77e remove egg and dist from the index as it is dynamically generated 2022-07-23 00:11:32 +08:00
bunnie
a43e0640f9 i'm not sure if these typically end up in repos, but they're there... 2022-07-22 22:29:32 +08:00
bunnie
5bce709d3c some cosmetic improvements and release notes acknowledgements 2022-07-22 22:28:46 +08:00
Jeremy O'Brien
b47fccde6a precursorupdater python package improvements
move precursorupdater's main into its own namespace and handle both
running from the repo directly and from pip
2022-07-22 09:53:04 -04:00
Jeremy O'Brien
52bcaa58b2 small fixes to make the precursor updater python package work through pip 2022-07-22 09:41:43 -04:00
bunnie
bc758749fb try to explicitly name the package.
this still did not work.
2022-07-22 20:11:57 +08:00
bunnie
11402ec5e6 reorg again 2022-07-22 19:54:06 +08:00
bunnie
80a8bba268 try to re-org again to get this to run as a script 2022-07-22 19:53:46 +08:00
bunnie
237ed14d28 finalize renaming so we don't have to deal with _ vs - ambiguities 2022-07-22 19:06:13 +08:00
bunnie
ee9f815fd6 restructure project 2022-07-22 19:05:26 +08:00
bunnie
4fa1236ce6 remove the _. i don't know the rules for how this transforms to - and when. 2022-07-22 18:54:56 +08:00
bunnie
aed8c89373 more restructer attemptings 2022-07-22 18:54:40 +08:00
bunnie
4e1a3beb3c try to restructure repo to work with...idk why i am even trying. 2022-07-22 18:54:21 +08:00
bunnie
ee4e2e5d65 fix metadata on packaging for precursor_updater
still not sure how to make this actually work as i want it to,
but at least there's a thing you can run to like...get dependencies,
I guess.

lame.
2022-07-22 18:10:32 +08:00
bunnie
8f6fa5f53d add a first draft of precursor_updater.py
this should be an "all in one" updater.
2022-07-22 03:46:31 +08:00
bunnie
bad4865ea3 shift restore.py to look at the tagged releases for artifacts 2022-07-21 01:10:52 +08:00
bunnie
8dc9dddfdd modify pdddbg.py to handle swapped up DNA for verifying rekey ops 2022-07-19 03:17:32 +08:00
bunnie
8f439f8d61 add the beginning of a CI/analysis tool for backups
for now all the tool can do is just make sure that the
header is valid, but it can't decrypt or operate on
the backup itself.
2022-07-17 22:49:03 +08:00
bunnie
8e6728d743 improve error handling in restore script 2022-07-17 22:48:03 +08:00
bunnie
13e13fdfd6 add some explanation in the restore process 2022-07-17 18:50:28 +08:00
bunnie
802decb55a initial drafts at the backup and restore helper scripts
very, very rough but i was able to run through an entire
cycle exactly once successfully.

much more testing needed.
2022-07-17 03:13:42 +08:00
bunnie
9c7b1e3228 update update script verbiage to reflect the latest flow 2022-07-17 03:13:13 +08:00
bunnie
7248f47ca8 fix self-signing to reflect extra data for semvers
the loader is a little funky, and requires some maintainer hand-holding
due to the split of the page ownership between the root-keys
crate and the graphics-server crate.

Improved docs so I don't forget this detail in the future.
2022-07-11 16:11:32 +08:00
bunnie
2ad7ed10d6 bump semver version 2022-07-11 04:13:19 +08:00
bunnie
1256fcb411 add min version requirement and current version to kernel and loader 2022-07-08 18:56:05 +08:00
bunnie
40b16b3cdb inject current semver info into signature appendix on loader and kernel
this allows for a quick readout of the version of each of these
artifacts, inside a signed region, by just inspecting the last
few words of the binary object.
2022-07-08 04:08:37 +08:00
bunnie
ae8fe799bc add a fuzzer for basis lock/unlocking
this commits a script that will repeatedly rerun the `btest`
which creates several Bases, fills them with pseudorandom datat,
and goes through a lock/unlock cycle.

should be run with the disk size set to 4MiB for maximum stress
testing (the larger disk won't trigger an FSCB refill because its
hard to run out free space on the larger disk size)
2022-07-04 17:53:29 +08:00
bunnie
97ae56915e fix edge case in --dump mode for pddbdb.py
shouldn't crash when not in CI analysis mode
2022-07-04 17:52:59 +08:00
bunnie
f14cce55ff update the updater readme
The FPGA gateware region is blocked from trivial readout via USB:
this makes it a tiny bit harder to obtain the gateware image, which
contains the secret keys. This slightly aids users who haven't
burned any efuse keys and are using the default "null" key from
a trivial readout attack, and it also hampers a WBSTAR exploit.

This makes the most convenient path of attack to be loading
a custom xous.img (or otherwise exploiting the kernel) with
a gadget that is capable of reading the gateware region
through priveleged code, and then relaying it over USB through
some run-around of the firewall. This primitive isn't impossible
to create but it doesn't exist and has no use in a normal
operational flow, so, it's going to at least force an attacker
to write some code, as opposed to using off the shelf utilities
we provide.
2022-06-29 13:20:52 +08:00
bunnie
e32ea4d3f5 fix #174 2022-06-10 21:36:53 +08:00
Sean Cross
aa436cbcc7 tools: elf: don't get raw_data for no_copy sections
The `xmas-elf` crate doesn't deal with `raw_data()` of sections that are
`NO_COPY`. These sections may point to data that is outside of the file.

In order to avoid hitting this assert, don't call `raw_data()` on
sections that are marked `NO_COPY`.

Signed-off-by: Sean Cross <sean@xobs.io>
2022-06-10 16:52:57 +08:00
bunnie
7112b6a15f add a script to help extract keyboard mappings for unknown keyboards
use `usb kbdtest` to output a mapping assuming US-101 maps
it will then derive an appropriate keymap based on that mapping

doesn't support non-ascii characters (yet)
2022-05-17 16:39:48 +08:00
bunnie
02daea2f0e add a note for STAGING area as well 2022-04-22 02:48:52 +08:00
bunnie
5bdd3a9f51 modifications to prepare for enhanced USB security
The next release will feature an access control on USB so that
root keys and the encrypted gateware cannot be read back and
transitively the writes would be guttered (but this is not a problem
because the write target address is not set by the memory location
of the write, it's actually set by the location specified in
the program command to the FLASH).

This means that the updating program has to be modified accordingly;
now, for writes, a single location is targeted (and as alluded above,
this is funneled to a write FIFO buffer, and then the actual address is
set with the page program command); and for readback, attempts to read
back the SoC area are flagged and noted as impossible due to security
precautions.
2022-04-22 02:48:43 +08:00
bunnie
b39f4c38eb fix update scripts so updates don't wipe root keys :-O 2022-04-20 17:15:46 +08:00
bunnie
9878dfc1a9 add a note about resetting the device properly after an update 2022-04-20 17:03:02 +08:00
bunnie
a31030bf90 remove excess wait state and clarify wait text 2022-04-20 16:59:19 +08:00
bunnie
15105cd0b2 fix update scripts to prevent device from self-resetting during updates 2022-04-20 16:57:10 +08:00
bunnie
4f9f1116fc fix various bugs in pddbg
note that there is still pddbg_v1 for the older version of the pddb
2022-04-20 03:47:17 +08:00
bunnie
758ed1ba31 some more fixes to pddbg to bring it up to v2. now passing CI. 2022-04-19 23:28:47 +08:00
bunnie
2d0af08266 bring pddbdbg up to v2 2022-04-19 15:57:51 +08:00
bunnie
d0f632965e add the old version of pddbg for debugging v1.x databases 2022-04-19 04:49:40 +08:00
bunnie
ba3639b00a prepare for v2 migration. more edits coming 2022-04-19 00:44:30 +08:00
bunnie
52f1afa780 commit some improvements to the CI framework 2022-03-31 00:28:49 +08:00
bunnie
e4eed87a55 Merge remote-tracking branch 'origin/main' into bunnie-dev 2022-03-29 16:45:56 +08:00
Aaron Bieber
6f98940189 Switch to using env to find the path to bash.
Systems like OpenBSD and NixOS have bash in different locations. This
allows the various scripts to be run on those systems.
2022-03-28 16:43:47 -06:00
bunnie
afb9974309 issue a warning if dup journal entries are found (pdddbg) 2022-03-29 04:37:35 +08:00
bunnie
0cf27be3b0 make the partition on dump vs ci analysis cleaner 2022-03-29 01:53:42 +08:00
bunnie
23041ab1f1 add a dump mode to pddbdbg.py so we can just view records
helpful for manual debugging
2022-03-29 01:47:00 +08:00
bunnie
c79afd4220 make sure the directory is not deleted 2022-03-28 04:09:57 +08:00
bunnie
6cbc93f8de make sure the directory is not deleted 2022-03-28 04:09:19 +08:00
bunnie
526a7374b0 re-introduce PDDB structure nuking on SoC reset 2022-03-20 15:25:14 +08:00
bunnie
b52b73ddfa add functionality to override the CSR data in case it is corrupted 2022-03-19 16:56:03 +08:00
bunnie
b06d7c4bb7 add a note about the hard reset 2022-03-19 16:31:37 +08:00
bunnie
1856a83e3e fix ordering of updates to prevent mid-update resets 2022-03-19 16:22:09 +08:00
bunnie
2aa72fae18
Update factory_reset.sh 2022-03-19 09:01:40 +08:00
bunnie
d9f4f6d041
Update factory_reset.ps1
move soc update to top so we don't get resets from latest xous
2022-03-19 09:00:58 +08:00
bunnie
eae61df786
Update factory_reset.sh
move soc update to the top to avoid wdt resets
2022-03-19 08:58:41 +08:00
bunnie
f7d42f6c1b correct usb_update.py force message to the correct version offsets 2022-03-18 17:39:45 +08:00
bunnie
dc2c393c5c update scripts to accept a locale argument 2022-03-10 16:22:48 +08:00
bunnie
dd017fb291 retire file-based versioning to symlink methodology 2022-02-28 16:06:48 +08:00
bunnie
2b3178be82 add a powershell script for bleeding edge CI
Because i don't know how to do variables in powershell :-/
2022-02-28 14:07:42 +08:00
bunnie
65499eb0fc bump version code in the pddbdbg.py script as well 2022-02-28 04:16:06 +08:00
bunnie
0b454cb7a8 evict salamanders from AES-GCM-SIV in the PDDB
So you'd like to think that an authenticating cipher would like,
authenticate stuff on decryption. And AES-GCM-SIV was billed as sort
of AES with the pointy edges taken off.

Well, there's always one more bug, actually this time a salamander:
https://eprint.iacr.org/2020/1456.pdf Apparently one can forge
authentication if the attacker can control keys and ciphertext. In the
case of the PDDB I think the attack is largely theoretical, because
you'd have to forge through both the AES-GCM-SIV and the rather
insufficient nonce/murmur hash check on the PTE that locates the page
to be decrypted.

But it's never good to have cryptographic properties depend upon
something that's known to be insufficient, so let's assume the attacker
can simply forge keys and stick some data on the device.

This wouldn't be a problem for confidentiality but it could lead to
the ability to plant evidence, but more importantly could lead to code
paths that were thought to be protected against fuzzing being fuzzed
as you could conceivably create a Basis root record that "checked out"
and then the larger body of the PDDB code would try to chomp on other
pages that are forged, leading to a bigger attack surface. Plus who
knows what else might exist beyond salamanders...

This patch does a "key commitment" on the Basis root page, so that it
is now cryptographically hard to create a salamander.  Basically
instead of using the system root key directly in AES-GCM-SIV, the key
goes through a KDF that expands it with yet another nonce plus a bit
of header data. The KDF is SHA512/256 and it expands it twice,
changing one bit in the header data (as prescribed by the paper cited
above), to create a version of the key that is written to disk (the
commitment), and a version of the key that is used to
decrypt/authenticate the AES-GCM-SIV data. Only if both the commitment
and the authentication check out, do we accept a Basis root page as
valid.

I had some concerns about the slightly different structure of the
Basis Root page being detectable, but I have been assured that the key
commitment form and the MAC in AES-GCM-SIV satisfy a property known as
IND$-CPA ("indistinguishable from uniform randomness by a
chosen-plaintext attacker") by Rogaway[1], and, more strongly, "Secure
nonce misuse-resistant authenticated encryption (mrAE)" by Gueron and
Lindell (see appendix for def)[2]. Still, just out of total paranoia
and nothing else, I organize the basis root page such that the MAC is
in the identical location as the other non-committed pages...just in
case there is some mathematical property of the MAC that could be
leveraged to leak info about the existence of the basis root record.
The commitment nonce and sha512/256 result I understand better and
feel pretty comfortable that they are going to be strongly random and
indistinguishable from AES ciphertext.

Thanks to Michael Rosenberg for taking the time to explain all this to
me and to guide me through the process of making the fixes. It is a
major PDDB API-breaking change and I'm glad it's able to be rolled out
before most users have received a device.

[1] https://web.cs.ucdavis.edu/~rogaway/papers/ad.pdf
[2] https://eprint.iacr.org/2015/102
2022-02-28 03:13:26 +08:00
taivlam
152abdac6b
Fix minor typos
Fixed minor typos in comments (I guessed "ts" was "its")
2022-02-14 19:45:12 -05:00
bunnie
b6b620b9b0 fix some paths 2022-02-10 00:46:20 +08:00
bunnie
2c3425d3fa add a release updater for windows as well 2022-02-10 00:46:09 +08:00
bunnie
ec64782f32 remove a trailing space 2022-02-10 00:39:50 +08:00
bunnie
d88d552260 add a windows version of the factory-reset command 2022-02-10 00:39:38 +08:00
bunnie
fcb67d5d16 fix argument order 2022-02-04 04:25:58 +08:00