[MCOL-932] mcsapi python packaging not working Created: 2017-09-20 Updated: 2023-10-26 Resolved: 2017-11-27 |
|
| Status: | Closed |
| Project: | MariaDB ColumnStore |
| Component/s: | None |
| Affects Version/s: | 1.1.0 |
| Fix Version/s: | 1.1.2 |
| Type: | Bug | Priority: | Minor |
| Reporter: | patrice | Assignee: | Unassigned |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Environment: |
centos7,all |
||
| Description |
|
Hi, I tried installing the python bindings for the mcsapi, it compiles correctly but the packaging to install with pip is not working. The package is imported from the pymcsapi.cpython.so but this shared library is not copied in the site-packages, therefor when doing an import pymcsapi the functions are not present. It only works if the shared library is in the same directory as the script importing the package. Patrice. |
| Comments |
| Comment by Andrew Hutchings (Inactive) [ 2017-09-20 ] |
|
Hi Patrice, Thanks for reporting this. We intentionally haven't released the Python parts yet due to install/packaging issues (in fact I've only tested Ubuntu 16.04 with Python 3 so far for packaging/install). We are looking into a better way of doing it. |
| Comment by David Thompson (Inactive) [ 2017-09-20 ] |
|
The python pybind11 binding is still in alpha state / work in progress and only available from source. Good to hear that you have been able to get it to work though as we haven't yet worked on packaging! We are also evaluating another binding framework too. |
| Comment by patrice [ 2017-09-28 ] |
|
I completed some testing, and it appears the python is really slow, it took 30 minutes to upload 900000 rows . I do not where the extra overhead is, probably is some conversion, it is more 3x times slower than using c++ directly. |
| Comment by David Thompson (Inactive) [ 2017-09-28 ] |
|
Thanks for testing. Yes it appears there is a significant overhead in the pybind11 framework somewhere. I plan to switch to using swig for the binding as this appears to be at least twice as fast (plus has the benefit it enables other languages). That plus the other async bug should get python in the same ballpark as python > file > cpimport which is my goal and hopefully maybe even faster. I'll let you know when we have something to test on both. |
| Comment by David Thompson (Inactive) [ 2017-11-27 ] |
|
This is resolved in the GA release, along with the move to swig for binding |