How to copy data from Azure SQL DB into Azure SQL DWHow do I get Brent Ozar's sp_BlitzIndex to run on...
Has any human ever had the choice to leave Earth permanently?
Is a new Boolean field better than a null reference when a value can be meaningfully absent?
Words and Words with "ver-" Prefix
What's a good word to describe a public place that looks like it wouldn't be rough?
Why are the books in the Game of Thrones citadel library shelved spine inwards?
How can my powered armor quickly replace its ceramic plates?
Do authors have to be politically correct in article-writing?
Slow While Loop, Query Improvment Assistance
How do you funnel food off a cutting board?
Eww, those bytes are gross
Can my spouse sponsor me for a UK visa if I am unemployed?
Does every functor from Set to Set preserve products?
Why wasn't TEventArgs made contravariant in the standard event pattern in the .NET ecosystem?
What is the purpose of easy combat scenarios that don't need resource expenditure?
Why is Agricola named as such?
In Linux what happens if 1000 files in a directory are moved to another location while another 300 files were added to the source directory?
using 'echo' & 'printf' in bash function calls
How would an AI self awareness kill switch work?
SET NOCOUNT Error in handling SQL call after upgrade
Is there any risk in sharing info about technologies and products we use with a supplier?
Exchange Online Migration: Single Tenant with Multiple Exchange Endpoints
In mixed effect models, how account for grouped random effects?
Why do neural networks need so many training examples to perform?
Is there a feather fall weight limit?
How to copy data from Azure SQL DB into Azure SQL DW
How do I get Brent Ozar's sp_BlitzIndex to run on Azure?CREATE DATABASE AS COPY does not work with AzureSQL backup to URL failures on Azure StorageHow to add a check constraint in sql azure data warehouse?Azure Sql data warehouse - is there any way to see the true query plan?Unable to connect on premise sql server from Sql Azure dbopenrowset to connect to SQL server with a password containing single quotesAzure SQL Server External Data SourcesCopy real time data from Azure SQL into Azure Data WarehouseCopy SQL Azure Hyperscale
I need to copy some data from an azure SQl DB instance into my azure data warehouse.
The most obvious way to do this is to use Elastic Query, similar to the below:
CREATE EXTERNAL DATA SOURCE SqlDb WITH
(TYPE = RDBMS,
LOCATION = 'myServer.database.windows.net',
DATABASE_NAME = 'MyAzureSqlDb',
CREDENTIAL = MyLogin,
) ;
Which appear to give the below error:
Msg 103010, Level 16, State 1, Line 7
Parse error at line: 2, column: 13: Incorrect syntax near 'RDBMS'.
Which I'm assuming means elastic query isn't supported. Are there any other easy methods to copy data from SqlDb -> SqlDw ? It's sounding like the only alternative is to get an ETL tool to do it.
azure-sql-database azure azure-sql-data-warehouse
bumped to the homepage by Community♦ 12 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
I need to copy some data from an azure SQl DB instance into my azure data warehouse.
The most obvious way to do this is to use Elastic Query, similar to the below:
CREATE EXTERNAL DATA SOURCE SqlDb WITH
(TYPE = RDBMS,
LOCATION = 'myServer.database.windows.net',
DATABASE_NAME = 'MyAzureSqlDb',
CREDENTIAL = MyLogin,
) ;
Which appear to give the below error:
Msg 103010, Level 16, State 1, Line 7
Parse error at line: 2, column: 13: Incorrect syntax near 'RDBMS'.
Which I'm assuming means elastic query isn't supported. Are there any other easy methods to copy data from SqlDb -> SqlDw ? It's sounding like the only alternative is to get an ETL tool to do it.
azure-sql-database azure azure-sql-data-warehouse
bumped to the homepage by Community♦ 12 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
I need to copy some data from an azure SQl DB instance into my azure data warehouse.
The most obvious way to do this is to use Elastic Query, similar to the below:
CREATE EXTERNAL DATA SOURCE SqlDb WITH
(TYPE = RDBMS,
LOCATION = 'myServer.database.windows.net',
DATABASE_NAME = 'MyAzureSqlDb',
CREDENTIAL = MyLogin,
) ;
Which appear to give the below error:
Msg 103010, Level 16, State 1, Line 7
Parse error at line: 2, column: 13: Incorrect syntax near 'RDBMS'.
Which I'm assuming means elastic query isn't supported. Are there any other easy methods to copy data from SqlDb -> SqlDw ? It's sounding like the only alternative is to get an ETL tool to do it.
azure-sql-database azure azure-sql-data-warehouse
I need to copy some data from an azure SQl DB instance into my azure data warehouse.
The most obvious way to do this is to use Elastic Query, similar to the below:
CREATE EXTERNAL DATA SOURCE SqlDb WITH
(TYPE = RDBMS,
LOCATION = 'myServer.database.windows.net',
DATABASE_NAME = 'MyAzureSqlDb',
CREDENTIAL = MyLogin,
) ;
Which appear to give the below error:
Msg 103010, Level 16, State 1, Line 7
Parse error at line: 2, column: 13: Incorrect syntax near 'RDBMS'.
Which I'm assuming means elastic query isn't supported. Are there any other easy methods to copy data from SqlDb -> SqlDw ? It's sounding like the only alternative is to get an ETL tool to do it.
azure-sql-database azure azure-sql-data-warehouse
azure-sql-database azure azure-sql-data-warehouse
asked Jul 23 '18 at 15:58
Neil PNeil P
629624
629624
bumped to the homepage by Community♦ 12 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
bumped to the homepage by Community♦ 12 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
As per Microsoft documentation here You can copy data from Azure SQL Data Warehouse to any supported sink data store. And you can copy data from any supported source data store to Azure SQL Data Warehouse. For a list of data stores that are supported as sources or sinks by Copy Activity, see the Supported data stores and formats table.
Specifically, this Azure SQL Data Warehouse connector supports these functions:
- Copy data by using SQL authentication and Azure Active Directory
(Azure AD) Application token authentication with a service principal
or Managed Service Identity (MSI). - As a source, retrieve data by using a SQL query or stored procedure.
- As a sink, load data by using PolyBase or a bulk insert. We recommend
PolyBase for better copy performance.
Important :- Note that PolyBase supports only SQL authentication but not Azure AD
authentication.
If you copy data by using Azure Data Factory Integration Runtime,
configure an Azure
SQL server firewall so that Azure services can access the server.
If you copy data by using a self-hosted integration runtime, configure
the Azure SQL server firewall to allow the appropriate IP range. This
range includes the machine's IP that is used to connect to Azure SQL
Database.
You can create a pipeline with the copy activity by using one of the following tools or SDKs. Select a link to go to a tutorial with step-by-step instructions to create a pipeline with a copy activity.
- Copy Data tool
- Azure portal
- .NET SDK
- Python SDK
- Azure PowerShell
- REST API
Azure Resource Manager template.
For your further ref here
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "182"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdba.stackexchange.com%2fquestions%2f212974%2fhow-to-copy-data-from-azure-sql-db-into-azure-sql-dw%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
As per Microsoft documentation here You can copy data from Azure SQL Data Warehouse to any supported sink data store. And you can copy data from any supported source data store to Azure SQL Data Warehouse. For a list of data stores that are supported as sources or sinks by Copy Activity, see the Supported data stores and formats table.
Specifically, this Azure SQL Data Warehouse connector supports these functions:
- Copy data by using SQL authentication and Azure Active Directory
(Azure AD) Application token authentication with a service principal
or Managed Service Identity (MSI). - As a source, retrieve data by using a SQL query or stored procedure.
- As a sink, load data by using PolyBase or a bulk insert. We recommend
PolyBase for better copy performance.
Important :- Note that PolyBase supports only SQL authentication but not Azure AD
authentication.
If you copy data by using Azure Data Factory Integration Runtime,
configure an Azure
SQL server firewall so that Azure services can access the server.
If you copy data by using a self-hosted integration runtime, configure
the Azure SQL server firewall to allow the appropriate IP range. This
range includes the machine's IP that is used to connect to Azure SQL
Database.
You can create a pipeline with the copy activity by using one of the following tools or SDKs. Select a link to go to a tutorial with step-by-step instructions to create a pipeline with a copy activity.
- Copy Data tool
- Azure portal
- .NET SDK
- Python SDK
- Azure PowerShell
- REST API
Azure Resource Manager template.
For your further ref here
add a comment |
As per Microsoft documentation here You can copy data from Azure SQL Data Warehouse to any supported sink data store. And you can copy data from any supported source data store to Azure SQL Data Warehouse. For a list of data stores that are supported as sources or sinks by Copy Activity, see the Supported data stores and formats table.
Specifically, this Azure SQL Data Warehouse connector supports these functions:
- Copy data by using SQL authentication and Azure Active Directory
(Azure AD) Application token authentication with a service principal
or Managed Service Identity (MSI). - As a source, retrieve data by using a SQL query or stored procedure.
- As a sink, load data by using PolyBase or a bulk insert. We recommend
PolyBase for better copy performance.
Important :- Note that PolyBase supports only SQL authentication but not Azure AD
authentication.
If you copy data by using Azure Data Factory Integration Runtime,
configure an Azure
SQL server firewall so that Azure services can access the server.
If you copy data by using a self-hosted integration runtime, configure
the Azure SQL server firewall to allow the appropriate IP range. This
range includes the machine's IP that is used to connect to Azure SQL
Database.
You can create a pipeline with the copy activity by using one of the following tools or SDKs. Select a link to go to a tutorial with step-by-step instructions to create a pipeline with a copy activity.
- Copy Data tool
- Azure portal
- .NET SDK
- Python SDK
- Azure PowerShell
- REST API
Azure Resource Manager template.
For your further ref here
add a comment |
As per Microsoft documentation here You can copy data from Azure SQL Data Warehouse to any supported sink data store. And you can copy data from any supported source data store to Azure SQL Data Warehouse. For a list of data stores that are supported as sources or sinks by Copy Activity, see the Supported data stores and formats table.
Specifically, this Azure SQL Data Warehouse connector supports these functions:
- Copy data by using SQL authentication and Azure Active Directory
(Azure AD) Application token authentication with a service principal
or Managed Service Identity (MSI). - As a source, retrieve data by using a SQL query or stored procedure.
- As a sink, load data by using PolyBase or a bulk insert. We recommend
PolyBase for better copy performance.
Important :- Note that PolyBase supports only SQL authentication but not Azure AD
authentication.
If you copy data by using Azure Data Factory Integration Runtime,
configure an Azure
SQL server firewall so that Azure services can access the server.
If you copy data by using a self-hosted integration runtime, configure
the Azure SQL server firewall to allow the appropriate IP range. This
range includes the machine's IP that is used to connect to Azure SQL
Database.
You can create a pipeline with the copy activity by using one of the following tools or SDKs. Select a link to go to a tutorial with step-by-step instructions to create a pipeline with a copy activity.
- Copy Data tool
- Azure portal
- .NET SDK
- Python SDK
- Azure PowerShell
- REST API
Azure Resource Manager template.
For your further ref here
As per Microsoft documentation here You can copy data from Azure SQL Data Warehouse to any supported sink data store. And you can copy data from any supported source data store to Azure SQL Data Warehouse. For a list of data stores that are supported as sources or sinks by Copy Activity, see the Supported data stores and formats table.
Specifically, this Azure SQL Data Warehouse connector supports these functions:
- Copy data by using SQL authentication and Azure Active Directory
(Azure AD) Application token authentication with a service principal
or Managed Service Identity (MSI). - As a source, retrieve data by using a SQL query or stored procedure.
- As a sink, load data by using PolyBase or a bulk insert. We recommend
PolyBase for better copy performance.
Important :- Note that PolyBase supports only SQL authentication but not Azure AD
authentication.
If you copy data by using Azure Data Factory Integration Runtime,
configure an Azure
SQL server firewall so that Azure services can access the server.
If you copy data by using a self-hosted integration runtime, configure
the Azure SQL server firewall to allow the appropriate IP range. This
range includes the machine's IP that is used to connect to Azure SQL
Database.
You can create a pipeline with the copy activity by using one of the following tools or SDKs. Select a link to go to a tutorial with step-by-step instructions to create a pipeline with a copy activity.
- Copy Data tool
- Azure portal
- .NET SDK
- Python SDK
- Azure PowerShell
- REST API
Azure Resource Manager template.
For your further ref here
answered Jul 23 '18 at 16:22
Md Haidar Ali KhanMd Haidar Ali Khan
3,71462342
3,71462342
add a comment |
add a comment |
Thanks for contributing an answer to Database Administrators Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdba.stackexchange.com%2fquestions%2f212974%2fhow-to-copy-data-from-azure-sql-db-into-azure-sql-dw%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown