Edit

Share via

Items - Create Data Pipeline

  • Reference
Service:
DataPipeline
API Version:
v1

Creates a data pipeline in the specified workspace.
This API supports long running operations (LRO).

Permissions

The caller must have contributor or higher workspace role.

Required Delegated Scopes

DataPipeline.ReadWrite.All or Item.ReadWrite.All

Limitations

  • To create a data pipeline, the workspace must be on a supported Fabric capacity.

Microsoft Entra supported identities

This API supports the Microsoft identities listed in this section.

Identity Support
User Yes
Service principal and Managed identities Yes

Interface

POST https://api.fabric.microsoft.com/v1/workspaces/{workspaceId}/dataPipelines

URI Parameters

Name In Required Type Description
workspaceId
 path True

string

uuid

The workspace ID.

Request Body

Name Required Type Description
displayName True

string

The data pipeline display name.
definition

DataPipelineDefinition

The data pipeline public definition.
description

string

The data pipeline description. Maximum length is 256 characters.

Responses

Name Type Description
201 Created

DataPipeline

Successfully created
202 Accepted

Request accepted, data pipeline provisioning in progress

Headers

  • Location: string
  • x-ms-operation-id: string
  • Retry-After: integer
Other Status Codes

ErrorResponse

Common error codes:

  • InvalidItemType - Item type is invalid

  • ItemDisplayNameAlreadyInUse - Item display name is already used

  • CorruptedPayload - The provided payload is corrupted

Examples

Create data pipeline example
Create data pipeline with item definition example

Create data pipeline example

Sample request

POST https://api.fabric.microsoft.com/v1/workspaces/cfafbeb1-8037-4d0c-896e-a46fb27ff229/dataPipelines

{
  "displayName": "DataPipeline 1",
  "description": "A data pipeline description"
}

Sample response

Status code:
201 
{
  "displayName": "DataPipeline 1",
  "description": "A data pipeline description",
  "type": "DataPipeline",
  "workspaceId": "cfafbeb1-8037-4d0c-896e-a46fb27ff229",
  "id": "5b218778-e7a5-4d73-8187-f10824047715"
}
Status code:
202 
Location: https://api.fabric.microsoft.com/v1/operations/0acd697c-1550-43cd-b998-91bfbfbd47c6
x-ms-operation-id: 0acd697c-1550-43cd-b998-91bfbfbd47c6
Retry-After: 30

Create data pipeline with item definition example

Sample request

POST https://api.fabric.microsoft.com/v1/workspaces/cfafbeb1-8037-4d0c-896e-a46fb27ff229/dataPipelines

{
  "displayName": "DataPipeline 1",
  "description": "A data pipeline description",
  "definition": {
    "parts": [
      {
        "path": "pipeline-content.json",
        "payload": "ewogICAgInByb3BlcnRpZXMiOiB7IAogICAgICAgICJkZXNjcmlwdGlvbiI6ICJEYXRhIHBpcGVsaW5lIGRlc2NyaXB0aW9uIiwgCiAgICAgICAgImFjdGl2aXRpZXMiOiBbIAogICAgICAgICAgICB7IAogICAgICAgICAgICAgICAgIm5hbWUiOiAiV2FpdF9BY3Rpdml0eV8xIiwgCiAgICAgICAgICAgICAgICAidHlwZSI6ICJXYWl0IiwgCiAgICAgICAgICAgICAgICAiZGVwZW5kc09uIjogW10sIAogICAgICAgICAgICAgICAgInR5cGVQcm9wZXJ0aWVzIjogeyAKICAgICAgICAgICAgICAgICAgICAid2FpdFRpbWVJblNlY29uZHMiOiAyNDAgCiAgICAgICAgICAgICAgICB9IAogICAgICAgICAgICB9LAogICAgICAgICAgICB7CiAgICAgICAgICAgICAgICAibmFtZSI6ICJXYWl0X0FjdGl2aXR5XzIiLAogICAgICAgICAgICAgICAgInR5cGUiOiAiV2FpdCIsCiAgICAgICAgICAgICAgICAiZGVwZW5kc09uIjogWwogICAgICAgICAgICAgICAgICAgIHsKICAgICAgICAgICAgICAgICAgICAgICAgImFjdGl2aXR5IjogIldhaXRfQWN0aXZpdHlfMSIsCiAgICAgICAgICAgICAgICAgICAgICAgICJkZXBlbmRlbmN5Q29uZGl0aW9ucyI6IFsgIlN1Y2NlZWRlZCIgXQogICAgICAgICAgICAgICAgICAgIH0KICAgICAgICAgICAgICAgIF0sCiAgICAgICAgICAgICAgICAidHlwZVByb3BlcnRpZXMiOiB7CiAgICAgICAgICAgICAgICAgICAgIndhaXRUaW1lSW5TZWNvbmRzIjogMjQwCiAgICAgICAgICAgICAgICB9CiAgICAgICAgICAgIH0KICAgICAgICBdCiAgICB9IAp9IA==",
        "payloadType": "InlineBase64"
      },
      {
        "path": ".platform",
        "payload": "ZG90UGxhdGZvcm1CYXNlNjRTdHJpbmc=",
        "payloadType": "InlineBase64"
      }
    ]
  }
}

Sample response

Status code:
201 
{
  "displayName": "DataPipeline 1",
  "description": "A data pipeline description",
  "type": "DataPipeline",
  "workspaceId": "cfafbeb1-8037-4d0c-896e-a46fb27ff229",
  "id": "5b218778-e7a5-4d73-8187-f10824047715"
}
Status code:
202 
Location: https://api.fabric.microsoft.com/v1/operations/0acd697c-1550-43cd-b998-91bfbfbd47c6
x-ms-operation-id: 0acd697c-1550-43cd-b998-91bfbfbd47c6
Retry-After: 30

Definitions

Name Description
CreateDataPipelineRequest

Create data pipeline request payload.
DataPipeline

A data pipeline object.
DataPipelineDefinition

Data pipeline public definition object.
DataPipelineDefinitionPart

Data pipeline definition part object.
ErrorRelatedResource

The error related resource details object.
ErrorResponse

The error response.
ErrorResponseDetails

The error response details.
ItemType

The type of the item. Additional item types may be added over time.
PayloadType

The type of the definition part payload. Additional payload types may be added over time.

CreateDataPipelineRequest

Object

Create data pipeline request payload.

Name Type Description
definition

DataPipelineDefinition

The data pipeline public definition.
description

string

The data pipeline description. Maximum length is 256 characters.
displayName

string

The data pipeline display name.

DataPipeline

Object

A data pipeline object.

Name Type Description
description

string

The item description.
displayName

string

The item display name.
id

string

uuid

The item ID.
type

ItemType

The item type.
workspaceId

string

uuid

The workspace ID.

DataPipelineDefinition

Object

Data pipeline public definition object.

Name Type Description
format

string

The format of the item definition.
parts

DataPipelineDefinitionPart[]

A list of definition parts.

DataPipelineDefinitionPart

Object

Data pipeline definition part object.

Name Type Description
path

string

The data pipeline part path.
payload

string

The data pipeline part payload.
payloadType

PayloadType

The payload type.

ErrorRelatedResource

Object

The error related resource details object.

Name Type Description
resourceId

string

The resource ID that's involved in the error.
resourceType

string

The type of the resource that's involved in the error.

ErrorResponse

Object

The error response.

Name Type Description
errorCode

string

A specific identifier that provides information about an error condition, allowing for standardized communication between our service and its users.
message

string

A human readable representation of the error.
moreDetails

ErrorResponseDetails[]

List of additional error details.
relatedResource

ErrorRelatedResource

The error related resource details.
requestId

string

ID of the request associated with the error.

ErrorResponseDetails

Object

The error response details.

Name Type Description
errorCode

string

A specific identifier that provides information about an error condition, allowing for standardized communication between our service and its users.
message

string

A human readable representation of the error.
relatedResource

ErrorRelatedResource

The error related resource details.

ItemType

Enumeration

The type of the item. Additional item types may be added over time.

Value Description
Dashboard

PowerBI dashboard.
DataPipeline

A data pipeline.
Datamart

PowerBI datamart.
Environment

An environment.
Eventhouse

An eventhouse.
Eventstream

An eventstream.
GraphQLApi

An API for GraphQL item.
KQLDashboard

A KQL dashboard.
KQLDatabase

A KQL database.
KQLQueryset

A KQL queryset.
Lakehouse

A lakehouse.
MLExperiment

A machine learning experiment.
MLModel

A machine learning model.
MirroredDatabase

A mirrored database.
MirroredWarehouse

A mirrored warehouse.
MountedDataFactory

A MountedDataFactory.
Notebook

A notebook.
PaginatedReport

PowerBI paginated report.
Reflex

A Reflex.
Report

PowerBI report.
SQLDatabase

A SQLDatabase.
SQLEndpoint

An SQL endpoint.
SemanticModel

PowerBI semantic model.
SparkJobDefinition

A spark job definition.
Warehouse

A warehouse.

PayloadType

Enumeration

The type of the definition part payload. Additional payload types may be added over time.

Value Description
InlineBase64

Inline Base 64.