Commit Graph
195 Commits
Author SHA1 Message Date
Xisco Fauli 27d0c9a3db build sqlite3 and lzma on Windows anyway
and use the same config.h in all platforms.
Compiling these libraries only takes a few seconds
so no need to exclude Windows here
it should also fix the win arm64 build

This patch reverts

commit e4421ce01d
Author: Xisco Fauli <xiscofauli@libreoffice.org>
Date:   Mon Nov 10 22:35:22 2025 +0100

    sqlite3: don't create a static library on Windows

and part of

commit 1cb84d60d9
Author: Xisco Fauli <xiscofauli@libreoffice.org>
Date:   Thu Oct 30 20:11:23 2025 +0100

    external: add lzma

Change-Id: Ia66242d4fef78cf8d99f853db4c9eee2e24c62ea
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/194023
Tested-by: Jenkins
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
2025-11-14 15:20:30 +01:00
Xisco Fauli 6408a49ac5 tdf#168513: python3: bundle lzma
Change-Id: I7b9729cd293aea781b204888236c3aa5aa858eaa
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/193739
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Tested-by: Jenkins
2025-11-11 21:40:00 +01:00
Xisco Fauli e4421ce01d sqlite3: don't create a static library on Windows
sqlite3 is later compiled on Windows by sqlite3.vcxproj

Change-Id: I77662cb5add82e812e2523a89a3d44b3ae05e095
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/193772
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Tested-by: Jenkins
2025-11-11 10:40:34 +01:00
Xisco Fauli 63460e46da related tdf#168511: bundle venvlauncher.exe too
Change-Id: I7f70d624d4952e85252b9e457fa309e1f8005490
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/193579
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Tested-by: Jenkins
2025-11-07 21:17:00 +01:00
Xisco Fauli 71d738ed14 some janitorial work
after

commit f98ce0f91b
Author: Xisco Fauli <xiscofauli@libreoffice.org>
Date:   Mon Oct 27 14:39:23 2025 +0100

    external: Add sqlite3

and

commit 1dfb0c9936
Author: Xisco Fauli <xiscofauli@libreoffice.org>
Date:   Tue Sep 23 13:17:41 2025 +0200

    tdf#168512: python3: bundle sqlite3

Based on https://gerrit.libreoffice.org/c/core/+/193225/comments/b7f0a403_822adc42

Change-Id: I82f9dd6b9238df94b5c4619d003f67871885945c
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/193351
Reviewed-by: Christian Lohmaier <lohmaier+LibreOffice@googlemail.com>
Tested-by: Jenkins
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
2025-11-03 17:15:50 +01:00
Xisco Fauli 4bf59e9258 python3: bundle _hashlib on Windows too
as Linux and MacOS already do

Change-Id: I42aae48a35e72b540a7fda51bb5907de2de64aab
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/193288
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Tested-by: Jenkins
2025-11-03 15:27:55 +01:00
Xisco Fauli b6d2fe4fcc tdf#168514: Add pythonw.exe
Change-Id: Ib007a7203114501d96f109f6d0c3d33d991be347
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/193258
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Tested-by: Jenkins
2025-10-31 16:44:35 +01:00
Xisco Fauli 3d57e6a9b5 tdf#132074: python3: bundle dbm
Change-Id: I1ed3c6e834f486cc8753513dfb03a2a0d4a8cfd4
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/193155
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Tested-by: Jenkins
2025-10-29 18:58:53 +01:00
Xisco Fauli 1dfb0c9936 tdf#168512: python3: bundle sqlite3
Add sqlite3.patch.1 since sqlite3.vcxproj expects the
sqlite version in the path

Change-Id: Ieb262b5401447cc9cc8c8d68197b3ec492c6ed94
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/191394
Tested-by: Jenkins
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
2025-10-29 14:21:29 +01:00
Xisco Fauli 087c49c15a python3: upgrade to 3.12.12
* Add external/python3/setuptools.patch.1 to deal with the space
in Lib/setuptools/_vendor/jaraco/text/Lorem ipsum.txt

Downloaded from https://www.python.org/ftp/python/3.12.12/Python-3.12.12.tar.xz

Change-Id: I0fe4730ee26267e0042fb10b6ad78bbc21ca1ce5
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/192758
Tested-by: Jenkins
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
2025-10-21 21:05:53 +02:00
Xisco Fauli dcd517331c related tdf#168511: bundle venv on mac too + Add test
I missed it in
commit dd8c42bf4b
Author: Xisco Fauli <xiscofauli@libreoffice.org>
Date:   Tue Sep 23 10:07:26 2025 +0200

    tdf#168511: python3: bundle venv

Change-Id: I180df8df27ece92aaa1feca379d280ff3f1ba2de
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/191392
Tested-by: Jenkins
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
2025-09-23 14:18:34 +02:00
Xisco Fauli dd8c42bf4b tdf#168511: python3: bundle venv
Change-Id: I5d4b03571099486b981f83b0487cdcbc4dd7a1a7
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/191377
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Tested-by: Jenkins
2025-09-23 11:21:40 +02:00
Christian Lohmaier 41ebd4c123 add --enable-gcov configure flag (instaed of manually setting flags)
there was already parts of that in the makefile that would require
running "make gb_GCOV=YES" - but that alone was not enough, you were
also kinda expected to set LDFLAGS on the commandline (or at least it
had bitrotted to this state) - so just make it into a proper configure
switch.
Building with lto fails at least on baseline with
/opt/rh/gcc-toolset-12/root/usr/libexec/gcc/x86_64-redhat-linux/12/ld: /tmp/ccaE1KD4.ltrans31.ltrans.o:(.data.rel.ro.local+0x3befe0)
: undefined reference to `.L1'
/opt/rh/gcc-toolset-12/root/usr/libexec/gcc/x86_64-redhat-linux/12/ld: /tmp/ccaE1KD4.ltrans31.ltrans.o:(.data.rel.ro.local+0x3befe8)
: undefined reference to `.L1'
/opt/rh/gcc-toolset-12/root/usr/libexec/gcc/x86_64-redhat-linux/12/ld: /tmp/ccaE1KD4.ltrans31.ltrans.o:(.data.rel.ro.local+0x3bf018)
: undefined reference to `.L2'
/opt/rh/gcc-toolset-12/root/usr/libexec/gcc/x86_64-redhat-linux/12/ld: /tmp/ccaE1KD4.ltrans31.ltrans.o:(.data.rel.ro.local+0x3bf020)
: undefined reference to `.L2'
[…many more of those with incrementing references…]
So for now warn if both are used.

Change-Id: I2c3427b48174de77a6894293a5e784df8ee24bd1
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/186821
Tested-by: Jenkins
Reviewed-by: Christian Lohmaier <lohmaier+LibreOffice@googlemail.com>
2025-06-23 15:15:58 +02:00
Stephan Bergmann fcaef01faf external/python3: Silence pointer-overflow
...as seen after 528cdd6573 "python3: upgrade to
3.12.11 (master only)" at <https://ci.libreoffice.org/job/lo_ubsan/3595/>,

> Parser/tokenizer.c:376:37: runtime error: pointer index expression with base 0x62500084d120 overflowed to 0xfffffffffffee800
>     #0 0xa65ab9 in restore_fstring_buffers /workdir/UnpackedTarball/python3/Parser/tokenizer.c:376:37
>     #1 0xa64eda in tok_reserve_buf /workdir/UnpackedTarball/python3/Parser/tokenizer.c:552:5
>     #2 0xa68b1e in tok_readline_raw /workdir/UnpackedTarball/python3/Parser/tokenizer.c:1014:10
>     #3 0xa60cbc in tok_underflow_file /workdir/UnpackedTarball/python3/Parser/tokenizer.c:1227:10
>     #4 0xa548d6 in tok_nextc /workdir/UnpackedTarball/python3/Parser/tokenizer.c:1367:12
>     #5 0xa4b4dd in tok_get_normal_mode /workdir/UnpackedTarball/python3/Parser/tokenizer.c:2423:11
>     #6 0xa390b7 in tok_get /workdir/UnpackedTarball/python3/Parser/tokenizer.c:2856:12
>     #7 0xa38e5c in _PyTokenizer_Get /workdir/UnpackedTarball/python3/Parser/tokenizer.c:2863:16
>     #8 0x504d53 in _PyPegen_fill_token /workdir/UnpackedTarball/python3/Parser/pegen.c:298:16
>     #9 0x50af1c in _PyPegen_expect_token /workdir/UnpackedTarball/python3/Parser/pegen.c:455:13
>     #10 0x55a2d5 in _tmp_7_rule /workdir/UnpackedTarball/python3/Parser/parser.c:25394:25
>     #11 0x50acba in _PyPegen_lookahead /workdir/UnpackedTarball/python3/Parser/pegen.c:446:24
>     #12 0x5510cc in compound_stmt_rule /workdir/UnpackedTarball/python3/Parser/parser.c:2075:13
>     #13 0x54ed4a in statement_rule /workdir/UnpackedTarball/python3/Parser/parser.c:1403:18
>     #14 0x54d056 in _loop1_3_rule /workdir/UnpackedTarball/python3/Parser/parser.c:25157:30
>     #15 0x54b9b2 in statements_rule /workdir/UnpackedTarball/python3/Parser/parser.c:1360:18
>     #16 0x54645a in file_rule /workdir/UnpackedTarball/python3/Parser/parser.c:1162:18
>     #17 0x5458e3 in _PyPegen_parse /workdir/UnpackedTarball/python3/Parser/parser.c:41920:18
>     #18 0x512537 in _PyPegen_run_parser /workdir/UnpackedTarball/python3/Parser/pegen.c:926:17
>     #19 0x513e5d in _PyPegen_run_parser_from_file_pointer /workdir/UnpackedTarball/python3/Parser/pegen.c:998:14
>     #20 0xa309e6 in _PyParser_ASTFromFile /workdir/UnpackedTarball/python3/Parser/peg_api.c:26:12
>     #21 0x16260ff in pyrun_file /workdir/UnpackedTarball/python3/Python/pythonrun.c:1665:11
>     #22 0x16236e6 in _PyRun_SimpleFileObject /workdir/UnpackedTarball/python3/Python/pythonrun.c:459:13
>     #23 0x1622618 in _PyRun_AnyFileObject /workdir/UnpackedTarball/python3/Python/pythonrun.c:78:15
>     #24 0x175112e in pymain_run_file_obj /workdir/UnpackedTarball/python3/Modules/main.c:361:15
>     #25 0x174f8ec in pymain_run_file /workdir/UnpackedTarball/python3/Modules/main.c:380:15
>     #26 0x174d6ed in pymain_run_python /workdir/UnpackedTarball/python3/Modules/main.c:634:21
>     #27 0x174c140 in Py_RunMain /workdir/UnpackedTarball/python3/Modules/main.c:714:5
>     #28 0x1a75e9b in main /workdir/UnpackedTarball/python3/Programs/_bootstrap_python.c:113:12
>     #29 0x7f018ebcf7e4 in __libc_start_main (/lib64/libc.so.6+0x3a7e4)
>     #30 0x42509d in _start (/workdir/UnpackedTarball/python3/_bootstrap_python+0x42509d)
>
> SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior Parser/tokenizer.c:376:37 in
> make[2]: *** [Makefile:1319: Python/frozen_modules/abc.h] Error 1
> make[2]: Leaving directory '/home/tdf/lode/jenkins/workspace/lo_ubsan/workdir/UnpackedTarball/python3'
> make[1]: *** [/home/tdf/lode/jenkins/workspace/lo_ubsan/external/python3/ExternalProject_python3.mk:85: /home/tdf/lode/jenkins/workspace/lo_ubsan/workdir/ExternalProject/python3/build] Error 1

Looks like the pair of remember_fstring_buffers and restore_fstring_buffers in
workdir/UnpackedTarball/python3/Parser/tokenizer.c temporarily sets pointers to
deliberately odd values

Change-Id: I700fe42cf95f608b42efa3f70c836782eb41e719
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/186649
Reviewed-by: Stephan Bergmann <stephan.bergmann@allotropia.de>
Tested-by: Jenkins
2025-06-18 12:44:34 +02:00
Xisco Fauli 528cdd6573 python3: upgrade to 3.12.11 (master only)
* Py_DontWriteBytecodeFlag is deprecated now, replace it with
PyConfig.write_bytecode

* setuptools and pip are no longer available by default on mac.
Get them from the wheel files the same way linux and windows do

Downloaded from https://www.python.org/ftp/python/3.12.11/Python-3.12.11.tar.xz

Change-Id: Id1043671d8fbb6b3bfa39afbf6aedd634c92c5f4
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/181785
Tested-by: Jenkins
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
2025-06-17 20:39:18 +02:00
Xisco Fauli e925155733 tdf#165120: pip: include .txt files
Change-Id: I06ce1fbfccf540113a918915488fa8a57527ce8f
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/186208
Tested-by: Jenkins
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
2025-06-05 16:04:41 +02:00
Xisco Fauli ffcdff2ff4 tdf#166746: pip: include .exe files
Change-Id: Ia4648ba2f51a1e04b1397bcde5e8321955854ba1
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/185907
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Tested-by: Xisco Fauli <xiscofauli@libreoffice.org>
2025-05-27 15:19:35 +02:00
Andras Timar 3ebf51d380 fix internal Python build for ppc64le platform
Change-Id: I1229e93ea7bf5dd24580fbf3114a4201270c0120
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/183810
Tested-by: Jenkins
Reviewed-by: Andras Timar <andras.timar@collabora.com>
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
2025-04-08 08:12:18 +02:00
Xisco Fauli 315febd7ea related tdf#162786, tdf#159988: fix arm64 for linux
Change-Id: Ia2670b3827880f4aba642390e68ffcc77dc63740
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/183371
Reviewed-by: Guillaume Paquereau <guillaume@carbone.io>
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Tested-by: Jenkins
2025-03-28 21:44:38 +01:00
Xisco Fauli 9b0668b6c5 python3: simplify code in makefile
Mac never executes this code. See

$(if $(filter MACOSX,$(OS)),GeneratedPackage_python3,ExternalPackage_python3)

in external/python3/Module_python3.mk

Change-Id: I928f480945279f13f8ff3c398ddbbed133b9d9ca
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/183369
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Tested-by: Jenkins
2025-03-27 11:11:39 +01:00
Xisco Fauli 3b18d95ba3 related tdf#162786: Add cacert.pem
In order to fix
ERROR: Could not install packages due to an OSError: Could not find a suitable TLS CA certificate bundle, invalid path:
/home/xisco/libreoffice/instdir/program/python-core-3.11.11/lib/pip/_vendor/certifi/cacert.pem
when using pip install

Change-Id: I84d6c23021523c11803bc2b0858d69a706da0dd0
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/180788
Tested-by: Jenkins
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
2025-01-27 20:12:03 +01:00
Xisco Fauli 3575986e30 tdf#162786, tdf#159988: python3: do not strip soabi on linux/macOS
Otherwise libraries installed through pip do not work

Change-Id: Ib916964ce7d309faffaad1763884b1600b139c18
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/180781
Tested-by: Jenkins
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
2025-01-27 15:46:25 +01:00
Christian Lohmaier 657efd649f macOS: simplify mac exclusion recipes
on branches 25-2 and 24-8 the python tkinter dylib is back.
The corresponding python module is ignored already, and the tkinter
cpython dylib already was removed in the past, but apparently at some
point that file wasn't generated anymore and the corresponding line to
delete it was removed in 6e62c9df96
That same commit also changed the filenames to use a * wildcard after
the python version, apparently to account for a "d" suffix in the
--enable-dbgutil case. In the spirit of the old commit to avoid rm -f
and to be explicit and catch potential other issues in future remove
that wildcard again/replace the suffix with a macro that contains the
appropriate suffix already as used in ExternalPackage_python3.mk.

Change-Id: I22b49af7dbf9a0bed5c124d9f137b8a38fee7471
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/180705
Tested-by: Jenkins
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Reviewed-by: Christian Lohmaier <lohmaier+LibreOffice@googlemail.com>
2025-01-27 13:37:45 +01:00
Xisco Fauli 47e110fc66 tdf#162786, tdf#161947: Add support for setuptools and pip
For that, just unzip the wheel files to the Lib directory

Change-Id: I3998e427aeadb840b626ebbb6ce91938de47d2b2
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/180271
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Tested-by: Jenkins
2025-01-21 22:05:50 +01:00
Stephan Bergmann 590157ac15 external/python: Don't package an _lzma library
...to avoid

> [build CHK] CustomTarget/postprocess/check_dynamic_objects/check.done
> instdir/program/python-core-3.11.11/lib/lib-dynload/_lzma.cpython-3.11d.so has suspicious NEEDED: liblzma.so.5

as seen at least when building on a Fedora 41 machine that happens to have
xz-devel-5.6.2-2.fc41.x86_64 installed (so that Python's configure detects
have_liblzma=yes).

The _lzma library had been added to external/python3/ExternalPackage_python3.mk
in 892c0d2ef0 "python3: update
python3_EXTENSION_MODULES", but without giving any rationale.  (It had
previously been removed there with c2e4e74138
"Python3.5: Remove external dependencies: readline and lzma".)

Change-Id: I4afe9fb08891dda116f115dac7b2f948aac84e06
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/180194
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Tested-by: Jenkins
Reviewed-by: Stephan Bergmann <stephan.bergmann@allotropia.de>
2025-01-13 23:20:11 +01:00
Xisco Fauli c9ae567c79 python3: get python.exe from extern
Instead of downloading nuget.exe and then python.exe
as explained in https://lists.freedesktop.org/archives/libreoffice/2025-January/092881.html,
Add python.3.12.8.nupkg to extern and download it as a tarball
to unzip it in external/pythonx86.
find_python.bat will look for python.exe in external/pythonx86/tools

Downloaded from
https://globalcdn.nuget.org/packages/python.3.12.8.nupkg?packageVersion=3.12.8

Change-Id: Ib1638fa66b3983048c2f9a472d00ce365602fcbb
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/180078
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Tested-by: Jenkins
2025-01-10 23:18:29 +01:00
Xisco Fauli 209bb3388a python3: fix win arm build
removed by mistake in
commit 50524481b3
Author: Xisco Fauli <xiscofauli@libreoffice.org>
Date:   Tue Dec 17 17:25:59 2024 +0100

    Python: upgrade to 3.11.11 (master only)

Change-Id: Ib1f79713e81238fd5c26cbbaf87e260a0a7e4f41
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/180032
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Tested-by: Jenkins
2025-01-10 08:31:22 +01:00
Stephan Bergmann e87fdbb86d external/python3: Avoid misaligned-pointer-use
...when generating Python/deepfreeze/deepfreeze.c during the build of
ExternalProject_python3 after 50524481b3 "Python:
upgrade to 3.11.11 (master only)",

> Objects/dictobject.c:1500:40: runtime error: load of misaligned address 0x555853494d81 for type 'PyDictUnicodeEntry *', which requires 8 byte alignment
> 0x555853494d81: note: pointer points here
>  00 00 00  ff ff ff ff ff ff ff ff  00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  00 00 00 00 00
>               ^
>  #0 in dictresize at workdir/UnpackedTarball/python3/Objects/dictobject.c:1500:21
>  #1 in dict_merge at workdir/UnpackedTarball/python3/Objects/dictobject.c:2880:17
>  #2 in _PyDict_MergeEx at workdir/UnpackedTarball/python3/Objects/dictobject.c:3003:12
>  #3 in _PyEval_EvalFrameDefault at workdir/UnpackedTarball/python3/Python/ceval.c:3432:17
>  #4 in _PyEval_EvalFrame at workdir/UnpackedTarball/python3/./Include/internal/pycore_ceval.h:73:16
>  #5 in _PyEval_Vector at workdir/UnpackedTarball/python3/Python/ceval.c:6434:24
>  #6 in _PyFunction_Vectorcall at workdir/UnpackedTarball/python3/Objects/call.c:393:16
>  #7 in _PyObject_FastCallDictTstate at workdir/UnpackedTarball/python3/Objects/call.c:141:15
>  #8 in _PyObject_Call_Prepend at workdir/UnpackedTarball/python3/Objects/call.c:482:24
>  #9 in slot_tp_init at workdir/UnpackedTarball/python3/Objects/typeobject.c:7855:15
>  #10 in type_call at workdir/UnpackedTarball/python3/Objects/typeobject.c:1103:19
>  #11 in _PyObject_MakeTpCall at workdir/UnpackedTarball/python3/Objects/call.c:214:18
>  #12 in _PyObject_VectorcallTstate at workdir/UnpackedTarball/python3/./Include/internal/pycore_call.h:90:16
>  #13 in PyObject_Vectorcall at workdir/UnpackedTarball/python3/Objects/call.c:299:12
>  #14 in _PyEval_EvalFrameDefault at workdir/UnpackedTarball/python3/Python/ceval.c:4769:23
>  #15 in _PyEval_EvalFrame at workdir/UnpackedTarball/python3/./Include/internal/pycore_ceval.h:73:16
>  #16 in _PyEval_Vector at workdir/UnpackedTarball/python3/Python/ceval.c:6434:24
>  #17 in PyEval_EvalCode at workdir/UnpackedTarball/python3/Python/ceval.c:1148:21
>  #18 in run_eval_code_obj at workdir/UnpackedTarball/python3/Python/pythonrun.c:1741:9
>  #19 in run_mod at workdir/UnpackedTarball/python3/Python/pythonrun.c:1762:19
>  #20 in pyrun_file at workdir/UnpackedTarball/python3/Python/pythonrun.c:1657:15
>  #21 in _PyRun_SimpleFileObject at workdir/UnpackedTarball/python3/Python/pythonrun.c:440:13
>  #22 in _PyRun_AnyFileObject at workdir/UnpackedTarball/python3/Python/pythonrun.c:79:15
>  #23 in pymain_run_file_obj at workdir/UnpackedTarball/python3/Modules/main.c:360:15
>  #24 in pymain_run_file at workdir/UnpackedTarball/python3/Modules/main.c:379:15
>  #25 in pymain_run_python at workdir/UnpackedTarball/python3/Modules/main.c:605:21
>  #26 in Py_RunMain at workdir/UnpackedTarball/python3/Modules/main.c:684:5
>  #27 in main at workdir/UnpackedTarball/python3/Programs/_bootstrap_python.c:109:12

Change-Id: I0bacef11b5874bca6104516a206076a0505528ed
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/180037
Tested-by: Jenkins
Reviewed-by: Stephan Bergmann <stephan.bergmann@allotropia.de>
2025-01-10 08:05:41 +01:00
Xisco Fauli 50524481b3 Python: upgrade to 3.11.11 (master only)
Downloaded from https://www.python.org/ftp/python/3.11.11/Python-3.11.11.tar.xz

* Add external/python3/replace-powershell-with-wget.patch.1
to avoid

FindPythonForBuild:
 Invoke-WebRequest : The request was aborted: Could not create SSL/TLS secure
 channel.
 At line:1 char:1
 + Invoke-WebRequest https://aka.ms/nugetclidl -OutFile
 'C:\cygwin64\home\tdf\jenki ...
 + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
 ~~~
     + CategoryInfo          : InvalidOperation: (System.Net.HttpWebRequest:Htt
    pWebRequest) [Invoke-WebRequest], WebException
     + FullyQualifiedErrorId : WebCmdletWebResponseException,Microsoft.PowerShe
    ll.Commands.InvokeWebRequestCommand

 'py' is not recognized as an internal or external command,
 operable program or batch file.

when downloading nuget.exe from https://aka.ms/nugetclidl
using powershell. By default powershell uses TLS 1.0 and the site security requires TLS 1.2,
so it fails with 'The request was aborted: Could not create SSL/TLS
secure channel.'

Kudos to Caolán for helping with a compiling issue.
See https://lists.freedesktop.org/archives/libreoffice/2024-December/092830.html

Change-Id: If66a88dd8f8c7774c49f8c33e9e40d2d5418e7c6
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/178681
Tested-by: Jenkins
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
2025-01-09 15:42:20 +01:00
Xisco Fauli 892c0d2ef0 python3: update python3_EXTENSION_MODULES
Change-Id: Ia636690f0dd9497e62ac9fd7a1ed4d00e71cc299
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/179896
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Tested-by: Jenkins
2025-01-08 10:56:32 +01:00
Xisco Fauli 02363a5cf5 related tdf#143980: python3: add ensurepip
Change-Id: Ia38a81cbcd14776b7fa1398856bd3f8997a869ff
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/178741
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Tested-by: Jenkins
2024-12-18 22:31:04 +01:00
Xisco Fauli 860e4b044a related tdf#162798: add script to create the list of external packages
Change-Id: Ifc24cb42df76c50f0ca40e3c793f36c355e483d8
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/178730
Tested-by: Xisco Fauli <xiscofauli@libreoffice.org>
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
2024-12-18 22:30:45 +01:00
Xisco Fauli a3adfdb2d9 tdf#162798: python3: Add lib/importlib/readers.py
Somehow I missed to add it in a1295cb177
"python: upgrade to 3.10.14 (master only)"

Change-Id: I53e5fa6b89a7ac799041fd28ef4c2558df9743e7
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/173323
Tested-by: Jenkins
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
2024-09-13 19:12:12 +02:00
Taichi Haradaguchi 07468c71ad libffi: Upgrade to 3.4.6
* external/libffi/implicit-function-declaration.patch was obsolete after
https://github.com/libffi/libffi/pull/764
* Backport external/python3/0001-bpo-45898-Remove-duplicate-symbols-from-_ctypes-cfie.patch.1
from upstream to fix build errors on Windows.

Change-Id: I6d7cd70dd29ea0ce4b22738637afa0e7eb76a93f
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/167337
Tested-by: Jenkins
Reviewed-by: Taichi Haradaguchi <20001722@ymail.ne.jp>
2024-07-16 02:08:59 +02:00
Xisco Fauli b2ae2fa78f lxml: ignore warnings when calling setup.py build too
Reverts dc97b366ab
"python3: silence distutils deprecated warning"
and f41773d684
"python3: silence distutils deprecated warning (take 2)"
and c920605dd4
"external/lxml: Fix --enable-python=fully-internal build"

Change-Id: I9131fa5ac22cf4f0279e7bf0edc5c50b61845044
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/170206
Tested-by: Jenkins
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
2024-07-09 16:37:02 +02:00
Xisco Fauli 24bf1dbb32 python3: easy_install no longer exists on macosx
/bin/sh: line 1: easy_install-3.10: No such file or directory

Also seen in libreoffice-24-2 branch with python 3.8
/bin/sh: line 1: easy_install-3.8: No such file or directory

Change-Id: Ia4b26c4526c03bec2f06f19ec6ea8539332d43da
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/170176
Tested-by: Jenkins
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
2024-07-09 10:46:30 +02:00
Xisco Fauli f41773d684 python3: silence distutils deprecated warning (take 2)
Since a1295cb177
"python: upgrade to 3.10.14 (master only)"

Now it fails with
Traceback (most recent call last):
  File "/home/tdf/lode/jenkins/workspace/lo_callgrind_linux/workdir/UnpackedTarball/lxml/setup.py", line 23, in <module>
    import setupinfo
  File "/home/tdf/lode/jenkins/workspace/lo_callgrind_linux/workdir/UnpackedTarball/lxml/setupinfo.py", line 7, in <module>
    from distutils.command.build_ext import build_ext as _build_ext
  File "/home/tdf/lode/jenkins/workspace/lo_callgrind_linux/instdir/program/python-core-3.10.14/lib/distutils/command/build_ext.py", line 13, in <module>
    from distutils.sysconfig import customize_compiler, get_python_version
  File "/home/tdf/lode/jenkins/workspace/lo_callgrind_linux/instdir/program/python-core-3.10.14/lib/distutils/sysconfig.py", line 58, in <module>
    warnings.warn(
DeprecationWarning: The distutils.sysconfig module is deprecated, use sysconfig instead
make[1]: *** [/home/tdf/lode/jenkins/workspace/lo_callgrind_linux/external/lxml/ExternalProject_lxml.mk:26: /home/tdf/lode/jenkins/workspace/lo_callgrind_linux/workdir/ExternalProject/lxml/build] Error 1

Change-Id: I9000018390b31a65a30ef87d0c500872fc6c9343
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/170069
Tested-by: Xisco Fauli <xiscofauli@libreoffice.org>
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
2024-07-06 18:54:59 +02:00
Xisco Fauli dc97b366ab python3: silence distutils deprecated warning
Since a1295cb177
"python: upgrade to 3.10.14 (master only)"
Some builds started to fail with

Traceback (most recent call last):
  File "/home/tdf/lode/jenkins/workspace/lo_callgrind_linux/workdir/UnpackedTarball/lxml/setup.py", line 15, in <module>
    from setuptools import setup
ModuleNotFoundError: No module named 'setuptools'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/tdf/lode/jenkins/workspace/lo_callgrind_linux/workdir/UnpackedTarball/lxml/setup.py", line 17, in <module>
    from distutils.core import setup
  File "/home/tdf/lode/jenkins/workspace/lo_callgrind_linux/instdir/program/python-core-3.10.14/lib/distutils/__init__.py", line 19, in <module>
    warnings.warn(_DEPRECATION_MESSAGE,
DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
make[1]: *** [/home/tdf/lode/jenkins/workspace/lo_callgrind_linux/external/lxml/ExternalProject_lxml.mk:26: /home/tdf/lode/jenkins/workspace/lo_callgrind_linux/workdir/ExternalProject/lxml/build] Error 1

The problem is that python 3.10 doesn't bundle setuptools so
it's not possible to replace it at the moment

Change-Id: I9a9d077b51f49e912dab4941efe8751c2fcc76e1
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/170068
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Tested-by: Jenkins
2024-07-06 17:37:46 +02:00
Xisco Fauli a1295cb177 python: upgrade to 3.10.14 (master only)
Downloaded from https://www.python.org/ftp/python/3.10.14/Python-3.10.14.tar.xz

* external/python3/macos-11.patch.0 should be long
obsolete by now

Change-Id: I454851f7684e699519370bdbbcd9bb9a2cccd077
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/170051
Tested-by: Jenkins
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
2024-07-05 23:15:07 +02:00
Xisco Fauli 4a3706db4f pyuno: fix deprecated warnings
* Replace PyUnicode_FromUnicode(str, len) with PyUnicode_FromWideChar(str, len)
* Replace PyUnicode_AS_UNICODE(PyObject) with PyUnicode_AsWideCharString(PyObject, size)

Change-Id: I1d8b46059d72f4de261d99393e1681f1e41eafdf
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/169625
Tested-by: Jenkins
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
2024-07-05 23:14:52 +02:00
Stephan Bergmann 9e6b4732ca Fix --disable-runtime-optimizations build
...after 19e9e49bda "python3: upgrade to 3.9.19",
by making external/python3/python-3.3.3-disable-obmalloc.patch.0 apply again

Change-Id: I295e470f3e86740ee276336dd04c227b2b316140
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/168695
Reviewed-by: Stephan Bergmann <stephan.bergmann@allotropia.de>
Reviewed-by: Xisco Fauli <xiscofauli@libreoffice.org>
Tested-by: Jenkins
2024-06-12 12:05:06 +02:00
Xisco Fauli 19e9e49bda python3: upgrade to 3.9.19
Downloaded from https://www.python.org/ftp/python/3.9.19/Python-3.9.19.tar.xz

* python-3.8-msvc-sdk.patch.1 is no longer needed

* Comment out deprecated warnings for now:
C:/cygwin64/home/tdf/jenkins/workspace/gerrit_windows/pyuno/source/module/pyuno_util.cxx(42): error C2220: the following warning is treated as an error
C:/cygwin64/home/tdf/jenkins/workspace/gerrit_windows/pyuno/source/module/pyuno_util.cxx(42): warning C4996: 'PyUnicode_FromUnicode': deprecated in 3.3
C:/cygwin64/home/tdf/jenkins/workspace/gerrit_windows/pyuno/source/module/pyuno_util.cxx(64): warning C4996: 'PyUnicode_AsUnicode': deprecated in 3.3

Change-Id: Iaa358ffaaea63cf6ec47914759d0469e70e1cc65
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/168551
Tested-by: Jenkins
Reviewed-by: Christian Lohmaier <lohmaier+LibreOffice@googlemail.com>
2024-06-11 11:48:44 +02:00
Christian Lohmaier 875a1bf2e1 makefile simplification: replace $(call gb_UnpackedTarball_get_dir,foo)
…by a simple/static $(gb_UnpackedTarball_workdir)/foo
see also 0c4c84a14b

Change-Id: I8e6aa55c85534c4446556548910c950ddbe7c6fc
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/167163
Reviewed-by: Christian Lohmaier <lohmaier+LibreOffice@googlemail.com>
Tested-by: Jenkins
2024-05-06 11:40:45 +02:00
Christian Lohmaier c1256034ff use --binary flag when applying patches with patch from git-bash
Change-Id: Idbd4ad7ad89dc727e2f0cf851c4c62f05d5b2a0c
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/166328
Tested-by: Jenkins
Reviewed-by: Christian Lohmaier <lohmaier+LibreOffice@googlemail.com>
2024-04-24 15:50:35 +02:00
Caolán McNamara 303ed9a964 python exits on initialization if fd 0 is a dir
which can happen if stdin was closed and the next
open was of a dir.

Later python checks for is_valid_fd, but an invalid fd
is not fatal for stdin, etc and it just return an empty
stdin wrapper, so move this check lower and do the same
for a dir.

Change-Id: Iaf8a48927b49408577ae7a781dfc6e0255a940cb
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/165327
Tested-by: Jenkins
Reviewed-by: Caolán McNamara <caolan.mcnamara@collabora.com>
2024-03-28 09:41:54 +01:00
Michael Stahl a2fabc78a4 python3: name gdb pretty-printer after .so, not .bin
So it works not only with instdir/program/python but also with
soffice in-process python.

Change-Id: I5c3643ef4a7ca0f25df3c6f51d11ff98c27f4bd8
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/159148
Tested-by: Jenkins
Reviewed-by: Michael Stahl <michael.stahl@allotropia.de>
2023-11-09 16:54:08 +01:00
Taichi Haradaguchi f1cb3bb773 Replace a tab with spaces
Change-Id: I06805f3c07b5baedfd492d701cb6f46da5ea913f
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/158322
Tested-by: Jenkins
Reviewed-by: Taichi Haradaguchi <20001722@ymail.ne.jp>
2023-10-22 14:45:16 +02:00
Julien Nabet 8797ba5e5d Typo: Unfortuantely->Unfortunately (python3/ExternalProject_python3.mk)
Change-Id: I80d316c76196d8cdda4b2ad509d2d1b53b5c414a
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/157991
Reviewed-by: Julien Nabet <serval2412@yahoo.fr>
Tested-by: Jenkins
2023-10-15 20:48:34 +02:00
Taichi Haradaguchi 7359700d5d Upgrade libffi to 3.4.4
Change-Id: I417abc5d76db235c23195abff22d3d27f9c0fa77
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/157972
Tested-by: Jenkins
Reviewed-by: Taichi Haradaguchi <20001722@ymail.ne.jp>
2023-10-14 15:51:09 +02:00
Taichi Haradaguchi c72d5d787f tdf#116412 include bz2 module in internal python
This commit includes the changes in 5e3510dbb6
and 219bef04b7, as well as the following changes:

* add bzip2 as permissable build target when cross compiling for Windows ARM64.
* add external/bzip2/disable-test.patch.0 for cross-compiling.
* revert the changes to configure.ac in 5e3510dbb6.
* change the argument of gb_UnpackedTarball_fix_end_of_line.

Change-Id: Iad8b1ed48d6c56e1302d9ac11620dc8084e79276
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/157101
Tested-by: Taichi Haradaguchi <20001722@ymail.ne.jp>
Reviewed-by: Taichi Haradaguchi <20001722@ymail.ne.jp>
2023-10-14 08:53:14 +02:00