Scanner classes

Scanner classes

Functions

Properties

gpointer scan-context Write / Construct Only
gboolean use-threads Read / Write
gint64 batch-size Read / Write
gpointer scan-options Write / Construct Only
GADScanContext * context Read / Write / Construct Only
GADScanOptions * options Read / Write / Construct Only
gpointer scan-task Write / Construct Only

Types and Values

Object Hierarchy

    GObject
    ├── GADScanContext
    ├── GADScanOptions
    ╰── GADScanTask
        ├── GADInMemoryScanTask
        ╰── GADInMemoryScanTask

Includes

#include <arrow-dataset-glib/arrow-glib.h>

Description

GADScanContext is a class for a scan context.

GADScanOptions is a class for a set of scan options.

GADScanTask is an abstract class for a scan task.

GADInMemoryScanTask is a class for a scan task of record batches.

Functions

gad_scan_context_new ()

GADScanContext *
gad_scan_context_new (void);

Returns

A newly created GADScanContext.

Since: 1.0.0


gad_scan_options_new ()

GADScanOptions *
gad_scan_options_new (GArrowSchema *schema);

Parameters

schema

A GArrowSchema.

 

Returns

A newly created GADScanOptions.

Since: 1.0.0


gad_scan_options_get_schema ()

GArrowSchema *
gad_scan_options_get_schema (GADScanOptions *scan_options);

Parameters

scan_options

A GADScanOptions.

 

Returns

A GArrowSchema.

[transfer full]

Since: 1.0.0


gad_scan_options_replace_schema ()

GADScanOptions *
gad_scan_options_replace_schema (GADScanOptions *scan_options,
                                 GArrowSchema *schema);

Parameters

scan_options

A GADScanOptions.

 

schema

A GArrowSchema.

 

Returns

A copy of the GADScanOptions with the given GArrowSchema.

[transfer full]

Since: 1.0.0


gad_scan_task_get_options ()

GADScanOptions *
gad_scan_task_get_options (GADScanTask *scan_task);

Parameters

scan_task

A GADScanTask.

 

Returns

A GADScanOptions.

[transfer full]

Since: 1.0.0


gad_scan_task_get_context ()

GADScanContext *
gad_scan_task_get_context (GADScanTask *scan_task);

Parameters

scan_task

A GADScanTask.

 

Returns

A GADScanContext.

[transfer full]

Since: 1.0.0


gad_scan_task_execute ()

GArrowRecordBatchIterator *
gad_scan_task_execute (GADScanTask *scan_task,
                       GError **error);

Parameters

scan_task

A GADScanTask.

 

error

Return location for a GError or NULL.

[nullable]

Returns

A newly created GArrowRecordBatchIterator, or NULL on error.

[nullable][transfer full]

Since: 1.0.0


gad_in_memory_scan_task_new ()

GADInMemoryScanTask *
gad_in_memory_scan_task_new (GArrowRecordBatch **record_batches,
                             gsize n_record_batches,
                             GADScanOptions *options,
                             GADScanContext *context);

Parameters

record_batches

(element-type GArrowRecordBatch): The record batches of the table.

[array length=n_record_batches]

n_record_batches

The number of record batches.

 

options

A GADScanOptions.

 

context

A GADScanContext.

 

Returns

A newly created GADInMemoryScanTask.

Since: 1.0.0

Types and Values

GAD_TYPE_SCAN_CONTEXT

#define GAD_TYPE_SCAN_CONTEXT (gad_scan_context_get_type())

struct GADScanContextClass

struct GADScanContextClass {
  GObjectClass parent_class;
};

GAD_TYPE_SCAN_OPTIONS

#define GAD_TYPE_SCAN_OPTIONS (gad_scan_options_get_type())

struct GADScanOptionsClass

struct GADScanOptionsClass {
  GObjectClass parent_class;
};

GAD_TYPE_SCAN_TASK

#define GAD_TYPE_SCAN_TASK (gad_scan_task_get_type())

struct GADScanTaskClass

struct GADScanTaskClass {
  GObjectClass parent_class;
};

GAD_TYPE_IN_MEMORY_SCAN_TASK

#define GAD_TYPE_IN_MEMORY_SCAN_TASK (gad_in_memory_scan_task_get_type())

struct GADInMemoryScanTaskClass

struct GADInMemoryScanTaskClass {
  GADScanTaskClass parent_class;
};

GADInMemoryScanTask

typedef struct _GADInMemoryScanTask GADInMemoryScanTask;

GADScanContext

typedef struct _GADScanContext GADScanContext;

GADScanOptions

typedef struct _GADScanOptions GADScanOptions;

GADScanTask

typedef struct _GADScanTask GADScanTask;

Property Details

The “scan-context” property

  “scan-context”             gpointer

The raw std::shared<arrow::dataset::ScanContext> *.

Flags: Write / Construct Only


The “use-threads” property

  “use-threads”              gboolean

Indicate if the Scanner should make use of a ThreadPool.

Flags: Read / Write

Default value: FALSE

Since: 1.0.0


The “batch-size” property

  “batch-size”               gint64

Maximum row count for scanned batches.

Flags: Read / Write

Allowed values: >= 0

Default value: 1048576

Since: 1.0.0


The “scan-options” property

  “scan-options”             gpointer

The raw std::shared<arrow::dataset::ScanOptions> *.

Flags: Write / Construct Only


The “context” property

  “context”                  GADScanContext *

The context of the scan task.

Flags: Read / Write / Construct Only

Since: 1.0.0


The “options” property

  “options”                  GADScanOptions *

The options of the scan task.

Flags: Read / Write / Construct Only

Since: 1.0.0


The “scan-task” property

  “scan-task”                gpointer

The raw std::shared<arrow::dataset::ScanTask> *.

Flags: Write / Construct Only