Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-1191

Missing details or default values of cpimport in the command helper and in the docs

    XMLWordPrintable

Details

    • Task
    • Status: Closed (View Workflow)
    • Minor
    • Resolution: Won't Do
    • None
    • Icebox
    • Documentation
    • None

    Description

      Missing details or default values of cpimport in the command helper and in the docs

      1.In the docs as well in the helper are missing details about some option values of cpimport
      2.it's not clear also if use cpimport with colxml job
      what's the correlation of colxml options and cpimport options
      for example is the -r option of cpimport the same as the -r of colxml ?
      if it's the same , but issue colxml and then cpimport with diffrent values of the same option which will be overruled ?

      for example
      from cpimport
      -b Number of read buffers
      -c Application read buffer size(in bytes)
      -r Number of readers.
      -e Max number of allowable error per table per PM
      -q Batch Quantity, Number of rows distributed per batch in Mode 1
      -B I/O library read buffer size (in bytes)
      -w Number of parsers.
      etc

       
      [root@um1 ~]# cpimport -h
      Simple usage using positional parameters (no XML job file):
              cpimport dbName tblName [loadFile] [-h] [-m mode]
                       [-f path] [-d debugLevel] [-c readbufSize] [-b readBufs]
                       [-r readers] [-j JobID] [-e maxErrs] [-B libBufSize] [-w parsers]
                       [-s c] [-E enclosedChar] [-C escapeChar] [-n NullOption]
                       [-q batchQty] [-p jobPath] [-P list of PMs] [-S] [-i] [-v verbose]
                       [-I binaryOpt]
      Traditional usage without positional parameters (XML job file required):
              cpimport -j jobID
                       [-h] [-m mode] [-r readers] [-w parsers] [-s c] [-f path]
                       [-b readBufs] [-p path] [-c readBufSize] [-e maxErrs] [-B libBufSize]
                       [-n NullOption] [-E encloseChar] [-C escapeChar] [-i] [-v verbose]
                       [-d debugLevel] [-q batchQty] [-l loadFile] [-P list of PMs] [-S]
                       [-I binaryOpt]
       
       
      Positional parameters:
              dbName     Name of the database to load
              tblName    Name of table to load
              loadFile   Optional input file name in current directory,
                              unless a fully qualified name is given.
                              If not given, input read from STDIN.
       
       
      Options:
              -b      Number of read buffers
              -c      Application read buffer size(in bytes)
              -d      Print different level(1-3) debug message
              -e      Max number of allowable error per table per PM
              -f      Data file directory path.
                              Default is current working directory.
                              In Mode 1, -f represents the local input file path.
                              In Mode 2, -f represents the PM based input file path.
                              In Mode 3, -f represents the local input file path.
              -l      Name of import file to be loaded, relative to -f path,
              -h      Print this message.
              -q      Batch Quantity, Number of rows distributed per batch in Mode 1
              -i      Print extended info to console in Mode 3.
              -j      Job ID. In simple usage, default is the table OID.
                              unless a fully qualified input file name is given.
              -n      NullOption (0-treat the string NULL as data (default);
                              1-treat the string NULL as a NULL value)
              -p      Path for XML job description file.
              -r      Number of readers.
              -s      'c' is the delimiter between column values.
              -B      I/O library read buffer size (in bytes)
              -w      Number of parsers.
              -E      Enclosed by character if field values are enclosed.
              -C      Escape character used in conjunction with 'enclosed by'
                              character, or as part of NULL escape sequence ('\N');
                              default is '\'
              -I      Import binary data; how to treat NULL values:
                              1 - import NULL values
                              2 - saturate NULL values
              -P      List of PMs ex: -P 1,2,3. Default is all PMs.
              -S      Treat string truncations as errors.
              -m      mode
                              1 - rows will be loaded in a distributed manner across PMs.
                              2 - PM based input files loaded onto their respective PM.
                              3 - input files will be loaded on the local PM.
       
      Example1: Traditional usage
              cpimport -j 1234
      Example2: Some column values are enclosed within double quotes.
              cpimport -j 3000 -E '"'
      Example3: Import a nation table without a Job XML file
              cpimport -j 301 tpch nation nation.tbl
      Example4: Import a nation table to all PMs in Mode 1
              cpimport -m 1 tpch nation nation.tbl
      Example4: Import a nation table to only PM1 and PM2 in Mode 1
              cpimport -m 1 -P 1,2 tpch nation nation.tbl
      Example5: Import nation.tbl from PMs to nation table in Mode 2
              cpimport -m 2 tpch nation -l nation.tbl
      Example6: Import nation.tbl in mode 3
              cpimport -m 3 tpch nation nation.tbl
       
      [root@um1 ~]#
      
      

      cpimport dbName tblName [loadFile]
      [-h] [-m mode] [-f filepath] [-d DebugLevel]
      [-c readBufferSize] [-b numBuffers] [-r numReaders]
      [-e maxErrors] [-B libBufferSize] [-s colDelimiter] [-E EnclosedByChar]
      [-C escChar] [-j jobID] [-p jobFilePath] [-w numParsers]
      [-n nullOption] [-P pmList] [-i] [-S] [-q batchQty]
       
      positional parameters:
      	dbName     Name of the database to load
      	tblName    Name of table to load
      	loadFile   Optional input file name in current directory,
      			unless a fully qualified name is given.
      			If not given, input read from STDIN.
      Options:
      	-b	Number of read buffers
      	-c	Application read buffer size(in bytes)
      	-d	Print different level(1-3) debug message
      	-e	Max number of allowable error per table per PM
      	-f	Data file directory path.
      			Default is current working directory.
      			In Mode 1, -f represents the local input file path.
      			In Mode 2, -f represents the PM based input file path.
      			In Mode 3, -f represents the local input file path.
      	-l	Name of import file to be loaded, relative to -f path,
      	-h	Print this message.
      	-q	Batch Quantity, Number of rows distributed per batch in Mode 1
      	-i	Print extended info to console in Mode 3.
      	-j	Job ID. In simple usage, default is the table OID.
      			unless a fully qualified input file name is given.
      	-n	NullOption (0-treat the string NULL as data (default);
      			1-treat the string NULL as a NULL value)
      	-p	Path for XML job description file.
      	-r	Number of readers.
      	-s	'c' is the delimiter between column values.
      	-B	I/O library read buffer size (in bytes)
      	-w	Number of parsers.
      	-E	Enclosed by character if field values are enclosed.
      	-C	Escape character used in conjunction with 'enclosed by'
      			character, or as part of NULL escape sequence ('\N');
      			default is '\'
      	-I	Import binary data; how to treat NULL values:
      			1 - import NULL values
      			2 - saturate NULL values
      	-P	List of PMs ex: -P 1,2,3. Default is all PMs.
      	-S	Treat string truncations as errors.
      	-m	mode
      			1 - rows will be loaded in a distributed manner across PMs.
      			2 - PM based input files loaded onto their respective PM.
      			3 - input files will be loaded on the local PM.
      

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              winstone Zdravelina Sokolovska (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.