GitLab

But do not ship it in sdist.

Closes #17133722.

Closes #17133734.

Related to #17133718.

The latter is deprecated since cubicweb 3.24.

Related to #17133718.

Related to #17133718.

Related to #17133718.

Also move ext_dump_relations and dump_relations function from sobjects
to avoid circular import and try to gather dataimport-related utilities
in a single module.

We still keep a dummy post321_import module as dowstream projects still
import it (noticeably cubicweb-seda).

Closes #17133718.

This module was only used for backwards-compatibility with ancient
cubicweb versions.

Related to #17133718.

Related to #17133718.

Related to #17133718.

Related to #17133718.

Bump required version of cubicweb to 3.24 as I'm not quire sure the code
will work with a version between 3.21 and 3.24 and 3.24 is already quite
old itself.

Related to #17133718.

We override this command in cubicweb-saem_ref and now need access to a
repository connection. The repository cannot however be instantiated
more than once in a given process (it is instantiated from admincnx()
call). So make a cached method to retrieve a connection.

This will be useful in cubicweb-saem_ref to specify parameters for the
metadata generator through an extra command option.

Instead of creating a dummy concept scheme from the file name, we now
require a pre-existing concept scheme's URI to be passed as a --scheme
argument when running an LCSV import from the command line. This matches
with the web UI behavior and makes it easier to integrate downstream
with cubicweb-saem_ref as this application has a custom handling of ARK
identifier which we could assign to the concept scheme previously
created during import.

We move the "Importing Skos dataset" down a bit because we may fail
earlier if the --scheme option is not specified and having this message
displayed is meaningless in such cases.

Related to Extranet #44146518.

It's clearer this way as it does not give the impression that we need to
use the object return by Connection.__enter__().

We add a --format option to "skos-import" ccplugin command with values
being "rdf" or "lcsv".

The lcsv format import behaves a bit differently than RDF import:

* only on file is accepted,
* a concept scheme is created beforehand to hold concepts to be imported
  from the LCSV file,
* this scheme is eventually dropped in case of import failure or
  interruption
* since lcsv_extentities() accepts a file object, we have to handle file
  opening and closing ourselves, hence the extentities_generator()
  wrapper function.

Closes extranet #37463080.

We handle a keyword argument 'stdout_check' in run_import_skos() test
helper and use its value to compare with process stdout. This will be
used in the next changeset.

We handle errors from import code as well as user interruption. This is
mostly in preparation of the next changeset in which we'll add some
cleanup logic.

We'll need to use another file in the next changeset.

Thus making the "delimiter" parameter of LCSV2RDF and lcsv_extentities()
optional.

Flake8 complains about that.

It seems that on form validation error when using the pyramid front-end, the
form values are stored by pyramid in the session cookie. If we don't pop
'stream' first, this silently fails because StringIO are not pickleable (and
_set_cookie fails silently), leading to a redirect to the original form without
any information.

Closes #17106505

it was crashing because of junk inserted in the posted data with an existing
entity (eid, __maineid, etc.)

Closes #17106504

by adding them to the MANIFEST.in file