summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2024-06-28esp32: Rework board variant support to require mpconfigvariant file.Damien George
This commit reworks board variants on the esp32 port. It's a simple change that moves the board variant configuration from an "if" statement within `mpconfigboard.cmake` into separate files for each variant, with the name of the variant encoded in the filename: `mpconfigvariant_VARIANT.cmake`. Optionally, the base variant can have its own options in `mpconfigvariant.cmake` (this is an optional file, but all other variants of the base must have a corresponding mpconfigvariant file). There are two benefits to this: - The build system now gives an error if the variant that you specified doesn't exist (because the mpconfigvariant file must exist with the variant name you specify). - No more error-prone if-logic needed in the .cmake files. The way to build a variant is unchanged, still via: $ make BOARD_VARIANT=VARIANT Signed-off-by: Damien George <damien@micropython.org>
2024-06-28tools/mpremote: Fix mpremote mip install with multiple lib in sys.path.Jos Verlinde
This is a fix for an algorithmic error in mpremote mip, that throws an error due to a '\n' used in the concatenation and split when there is more than one lib path in `sys.path`. Signed-off-by: Jos Verlinde <Jos.Verlinde@microsoft.com>
2024-06-27tools/mpy-tool.py: Implement freezing of long-long ints.Yoctopuce
Allow inclusion of large integer constants in frozen files using long-long representation (mpy-cross option -mlongint-impl=longlong). Signed-off-by: Yoctopuce <dev@yoctopuce.com>
2024-06-27tools/ci.sh: Build an stm32 board with -O2 enabled.Damien George
To test building with full optimisations. Signed-off-by: Damien George <damien@micropython.org>
2024-06-27stm32/pin: Decrease machine_pin_obj_t.pin width from 5 to 4 bits.Damien George
Compiling using arm-none-eabi-gcc 14.1.0 with -O2 will give warnings about possible overflow indexing extint arrays, such as `pyb_extint_callback`. This is due to `machine_pin_obj_t.pin` having a bit-width of 5, and so a possible value up to 31, which is usually larger than `PYB_EXTI_NUM_VECTORS`. To fix this, change `machine_pin_obj_t.pin` to a bit-width of 4. Only 4 bits are needed for ST MCUs, which have up to 16 pins per port. Signed-off-by: Damien George <damien@micropython.org>
2024-06-27extmod/extmod.mk: Disable maybe-uninitialized warnings in libm_dbl.Damien George
These warnings are emitted by arm-none-eabi-gcc 14.1.0 with -O2 enabled. Signed-off-by: Damien George <damien@micropython.org>
2024-06-26shared/tinyusb/mp_usbd_cdc: Fix short CDC TX timeouts.Damien George
The `mp_event_wait_ms()` function may return earlier than the requested timeout, and if that happens repeatedly (eg due to lots of USB data and IRQs) then the loop waiting for CDC TX FIFO space to become available may exit much earlier than MICROPY_HW_USB_CDC_TX_TIMEOUT, even when there is no space. Fix this by using `mp_hal_ticks_ms()` to compute a more accurate timeout. The `basics/int_big_mul.py` test fails on RPI_PICO without this fix. Signed-off-by: Damien George <damien@micropython.org>
2024-06-26github: Add Pull Request template.Angus Gratton
Provides pull request submitters with contributor documentation, and prompts them to provide relevant information about testing, and how they came to implement this change. Sections are deliberately small so they don't crowd out the GitHub Pull Request description text field. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>
2024-06-26README: Clean up a few bits of grammar.tharuka
The word "Select" could be confusing in this context, eg it could be misunderstood as the `select` module. Signed-off-by: tharuka <78165134+tharuka-pavith@users.noreply.github.com>
2024-06-26py/objarray: Fix buffer overflow in case of memory allocation failure.Yoctopuce
If `array.append()` fails with an exception due to heap exhaustion, the next attempt to grow the buffer will cause a buffer overflow because the free slot count is increased before performing the allocation, and will stay as if the allocation succeeded. Signed-off-by: Yoctopuce <dev@yoctopuce.com>
2024-06-26shared/tinyusb/mp_usbd_runtime: Fix pointer comparison in assert.Peter Harper
Addresses build warning "comparison of distinct pointer types lacks a cast". Fixes issue #15276. Signed-off-by: Peter Harper <peter.harper@raspberrypi.com>
2024-06-26rp2/pendsv: Fix variable typo in assert so it compiles.Peter Harper
Fixes issue #15276. Signed-off-by: Peter Harper <peter.harper@raspberrypi.com>
2024-06-25rp2: Don't disable USB if going to DORMANT mode.Angus Gratton
In this mode, XOSC is stopped so can't really keep the USB PLL enabled. Signed-off-by: Angus Gratton <angus@redyak.com.au>
2024-06-25rp2: Fix USB PLL glitch during wake from light sleep.Angus Gratton
Follow-up to a84c7a0ed93, this commit works most of the time but has an intermittent bug where USB doesn't resume as expected after waking from light sleep. Turns out waking calls clocks_init() which will re-initialise the USB PLL. Most of the time this is OK but occasionally it seems like the clock glitches the USB peripheral and it stops working until the next hard reset. Adds a machine.lightsleep() test that consistently hangs in the first two dozen iterations on rp2 without this fix. Passed over 100 times in a row with this fix. The test is currently rp2-only as it seems similar lightsleep USB issues exist on other ports (both pyboard and ESP32-S3 native USB don't send any data to the host after waking, until they receive something from the host first.) This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>
2024-06-25rp2/clocks_extra: Implement custom clocks_init function.Angus Gratton
Adapts pico-sdk clocks_init() into clocks_init_optional_usb() which takes an argument to initialise USB clocks or not. To avoid a code size increase the SDK clocks_init() function is linker wrapped to become clocks_init_optional_usb(true). This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>
2024-06-25rp2: Fix recursive atomic sections when core1 is active.Angus Gratton
mp_thread_begin_atomic_section() is expected to be recursive (i.e. for nested machine.disable_irq() calls, or if Python code calls disable_irq() and then the Python runtime calls mp_handle_pending() which also enters an atomic section to check the scheduler state). On rp2 when not using core1 the atomic sections are recursive. However when core1 was active (i.e. _thread) then there was a bug that caused the core to live-lock if an atomic section recursed. Adds a test case specifically for mutual exclusion and recursive atomic sections when using two threads. Without this fix the test immediately hangs on rp2. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>
2024-06-24py/objint: Fix int.to_bytes() buffer size checks.Angus Gratton
Fixes and improvements to `int.to_bytes()` are: - No longer overflows if byte size is 0 (closes #13041). - Raises OverflowError in any case where number won't fit into byte length (now matches CPython, previously MicroPython would return a truncated bytes object). - Document that `micropython int.to_bytes()` doesn't implement the optional signed kwarg, but will behave as if `signed=True` when the integer is negative (this is the current behaviour). Add tests for this also. Requires changes for small ints, MPZ large ints, and "long long" large ints. Adds a new set of unit tests for ints between 32 and 64 bits to increase coverage of "long long" large ints, which are otherwise untested. Tested on unix port (64 bit small ints, MPZ long ints) and Zephyr STM32WB board (32 bit small ints, long long large ints). This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>
2024-06-24py/misc: Move mp_clz and mp_ctz intrinsics into misc.h.Angus Gratton
Signed-off-by: Angus Gratton <angus@redyak.com.au>
2024-06-21tools/mpremote: Fix absolute path usage in remote mounted VFS.Damien George
Prior to this fix the current working path in the remote VFS would always be prepended to the requested path to get the full path, even if the requested path was already absolute, ie starting with "/". So `os.chdir("/remote/dir1")` would set the working path to "/dir1/", and a subsequent call with an absolute path like `os.listdir("/remote/dir2")` would try to list the directory "/dir1/dir2/". Fixes issue #15308. Signed-off-by: Damien George <damien@micropython.org>
2024-06-21tests/basics: Add tests to test repeated throw into the same generator.Damien George
Signed-off-by: Damien George <damien@micropython.org>
2024-06-21py/emitnative: Fix native async with.Damien George
The code generating the entry to the finally handler of an async-with statement was simply wrong for the case of the native emitter. Among other things the layout of the stack was incorrect. This is fixed by this commit. The setup of the async-with finally handler is now put in a dedicated emit function, for both the bytecode and native emitters to implement in their own way (the bytecode emitter is unchanged, just factored to a function). With this fix all of the async-with tests now work when using the native emitter. Signed-off-by: Damien George <damien@micropython.org>
2024-06-21py/emitnative: Place thrown value in dedicated local variable.Damien George
A value thrown/injected into a native generator needs to be stored in a dedicated variable outside `nlr_buf_t`, following the `inject_exc` variable in `py/vm.c`. Signed-off-by: Damien George <damien@micropython.org>
2024-06-21py/emitndebug: Add native debug emitter.Damien George
This emitter prints out pseudo-machine instructions, instead of the usual output of the native emitter. It can be enabled on any port via `MICROPY_EMIT_NATIVE_DEBUG` (make sure other native emitters are disabled) but the easiest way to use it is with mpy-cross: $ mpy-cross -march=debug file.py Signed-off-by: Damien George <damien@micropython.org>
2024-06-21py/emitnative: Add more DEBUG_printf statements.Damien George
Signed-off-by: Damien George <damien@micropython.org>
2024-06-21qemu-riscv: Enable native code generation by default.Alessandro Gatti
This turns on the native RV32IMC code generator for the QEMU-based RISC-V port, and removes tests that relies on native code generation from the exclusion list (ie enables these tests). Signed-off-by: Alessandro Gatti <a.gatti@frob.it>
2024-06-21py/emitnative: Emit better load/store sequences for RISC-V RV32IMC.Alessandro Gatti
Selected load/store code sequences have been optimised for RV32IMC when the chance to use fewer and smaller opcodes was possible. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>
2024-06-21mpy-cross: Add RISC-V RV32IMC support in MPY files.Alessandro Gatti
MPY files can now hold generated RV32IMC native code. This can be accomplished by passing the `-march=rv32imc` flag to mpy-cross. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>
2024-06-21py/asmrv32: Add RISC-V RV32IMC native code emitter.Alessandro Gatti
This adds a native code generation backend for RISC-V RV32I CPUs, currently limited to the I, M, and C instruction sets. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>
2024-06-21tests/thread: Re-enable GC before stress_schedule test ends.Angus Gratton
Otherwise GC stays disabled (not re-enabled by soft reset) and later test runs fail with MemoryError. Signed-off-by: Angus Gratton <angus@redyak.com.au>
2024-06-21tests/cpydiff: Remove deque difference test.Damien George
Because `collections.deque` is now a built-in type in MicroPython. Signed-off-by: Damien George <damien@micropython.org>
2024-06-21py/objdeque: Fix deque type flags based on option settings.Dan Halbert
This fixes a minor issue in the changes made by 7dff38fdc190d7b731fad8319d2ae8aa13fde18a: the type flags for deque were meant to be conditionalized based on MICROPY_PY_COLLECTIONS_DEQUE_ITER, but the computed conditionalized value wasn't used. Signed-off-by: Dan Halbert <halbert@halwitz.org>
2024-06-20webassembly/api: Allow specifying the pystack size.Damien George
This allows increasing the Python recursion depth if needed. Also increase the default to 2k words. There is enough RAM in the browser/node context for this to be increased, and having a larger pystack allows more complex code to run without hitting the limit. Signed-off-by: Damien George <damien@micropython.org>
2024-06-20webassembly/asyncio: Schedule run loop when tasks are pushed to queue.Damien George
In the webassembly port there is no asyncio run loop running at the top level. Instead the Python asyncio run loop is scheduled through setTimeout and run by the outer JavaScript event loop. Because tasks can become runable from an external (to Python) event (eg a JavaScript callback), the run loop must be scheduled whenever a task is pushed to the asyncio task queue, otherwise tasks may be waiting forever on the queue. Signed-off-by: Damien George <damien@micropython.org>
2024-06-20extmod/modasyncio: Add support for a callback on TaskQueue push.Damien George
Allows passing in a callback to `TaskQueue()` that is called when something is pushed on to the queue. Signed-off-by: Damien George <damien@micropython.org>
2024-06-18webassembly/asyncio: Support top-level await of asyncio Task and Event.Damien George
This change allows doing a top-level await on an asyncio primitive like Task and Event. This feature enables a better interaction and synchronisation between JavaScript and Python, because `api.runPythonAsync` can now be used (called from JavaScript) to await on the completion of asyncio primitives. Signed-off-by: Damien George <damien@micropython.org>
2024-06-18webassembly/objjsproxy: Implement proxying of JS iterable protocol.Damien George
This allows Python to iterate over JavaScript objects that provide Symbol.iterator. Signed-off-by: Damien George <damien@micropython.org>
2024-06-18zephyr: Link MicroPython with the Zephyr kernel library.Maureen Helm
Unlike most other Zephyr libraries, libkernel.a is not built as a whole-archive. This change also fixes a linker error observed on nucleo_wb55rg while preparing an upgrade to Zephyr v3.5.0, caused by an undefined reference to `z_impl_k_busy_wait`. Signed-off-by: Maureen Helm <maureen.helm@analog.com>
2024-06-18zephyr/modsocket: Add socket.recvfrom method.Jason Kridner
Signed-off-by: Jason Kridner <jkridner@beagleboard.org>
2024-06-18zephyr/modzsensor: Add additional sensor type constants.Jason Kridner
Signed-off-by: Jason Kridner <jkridner@beagleboard.org>
2024-06-17extmod/modplatform: Add picolibc to the recognised libcs list.Alessandro Gatti
This adds picolibc to the list of the recognised libc options. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>
2024-06-17github/workflows: Add qemu-riscv port to CI.Alessandro Gatti
Signed-off-by: Alessandro Gatti <a.gatti@frob.it>
2024-06-17qemu-riscv: Add new QEMU RV32 port.Alessandro Gatti
This adds a QEMU-based bare metal RISC-V 32 bits port. For the time being only QEMU's "virt" 32 bits board is supported, using the ilp32 ABI and the RV32IMC architecture. The top-level README and the run-tests.py files are updated for this new port. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>
2024-06-11qemu-arm: Clean up header file includes.Damien George
Signed-off-by: Damien George <damien@micropython.org>
2024-06-11qemu-arm: Add license and copyright to files missing them.Damien George
All of these files are first-party code written from scratch as part of this repository, and were added when the top-level MIT license was active, so they have an MIT license by default. Tracing back the git history show the original authors/source/copyright as follows: - main.c, mpconfigport.h: copied from the bare-arm port [1]. - test_main.c: added in [2]. - mphalport.h: added in [3] then updated in [4]. - mps2.ld, nrf51.ld, stm32.ld, uart.h: added in [4]. - imx6.ld, uart.c, startup.c: added in [4] and updated in [5]. [1] Commit c55721582282f282d33e35e458a2944890210ebc in 2014, the initial bare-arm port; see related ee857853d60a135685c5088e5492dfe6e8a5acb0. [2] Commit c1c32d65af038ba1b2a2a8dd69e3f7e63eac5f3e in 2014, initial qemu-arm CI tests. [3] Commit b0a15aa73540f82ef47c9492af7ce196d1b1a6e9 in 2016, enabling extmods and their tests. [4] Commit e7332b05841549a41614e522285639dcaa7bd526 in 2018, big refactor. [5] Commit b84406f3133a36a703a1506d754fc046dd955922 in 2021, adding Cortex-A9 support. Signed-off-by: Damien George <damien@micropython.org>
2024-06-08extmod/modlwip: Consolidate socket.accept timeout logic.Damien George
This makes the code a bit simpler to understand for the three cases of timeout behaviour (-1, 0, non-zero), and eliminates a dependency on the (slow) `mp_hal_delay_ms(100)` call. Signed-off-by: Damien George <damien@micropython.org>
2024-06-08extmod/modlwip: Make socket.connect raise ETIMEDOUT on non-zero timeout.Damien George
If the socket timeout is 0 then a failed socket.connect() raises EINPROGRESS (which is what the lwIP bindings already did), but if the socket timeout is non-zero then a failed socket.connect() should raise ETIMEDOUT. The latter is fixed in this commit. A test is added for these timeout cases. Signed-off-by: Damien George <damien@micropython.org>
2024-06-08rp2/cyw43_configport: Make cyw43_delay_ms() a busy loop.Damien George
Currently, `cyw43_delay_ms()` calls `mp_hal_delay_ms()` which uses PendSV to set up a timer and wait for an interrupt, using wfe. But in the cyw43 initialisation stage PendSV is disabled and so this delay suspends on the wfe instruction for an indefinite amount of time. Work around this by changing the implementation of `cyw43_delay_ms()` to a busy loop. Fixes issue #15220. Signed-off-by: Damien George <damien@micropython.org>
2024-06-06py/lexer: Support raw f-strings.Damien George
Support for raw str/bytes already exists, and extending that to raw f-strings is easy. It also reduces code size because it eliminates an error message. Signed-off-by: Damien George <damien@micropython.org>
2024-06-06py/lexer: Support concatenation of adjacent f-strings.Damien George
This is quite a simple and small change to support concatenation of adjacent f-strings, and improve compatibility with CPython. Signed-off-by: Damien George <damien@micropython.org>
2024-06-06lib/libm: Define _IEEE_LIBM only if not set.Alessandro Gatti
fdilibm was originally meant to see _IEEE_LIBM defined from outside the libm code, not it being hardcoded in. Picolibc assumes this assumption holds true and attempts to define itself, conflicting with the existing definition. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>