Unsolved
3 Posts
0
1484
EMC ECS Configuration with Apache Drill
I'm trying to configure Apache Drill with ECS, it was quite easy configuring with AWS S3 and GCP Cloud Storage, but I'm facing issues configuring with ECS,
When I use http with port 9020 as endpoint I face this error
Error:SYSTEM ERROR: AmazonS3Exception: Status Code: 405, AWS Service:Amazon S3, AWS Request ID:, AWS Error Code:null, AWS Error Message: Method Not Allowed
When I use https with port 9021 as endpoint I face this error
Error:SYSTEM ERROR: SSLPeerUnverifiedException: peer not authenticated
core-site.xml
fs.s3a.access.key
accesskey
fs.s3a.secret.key
secretkey
fs.s3a.endpoint
https://:9020
fs.s3a.connection.ssl.enabled
false
and for connecting to the bucket i use the following in the storage plugin
{
"type" : "file",
"connection" : "s3a://bucketname/",
"config" : {
"fs.s3a.impl.disable.cache" : "true"
},
"workspaces" : {
"tmp" : {
"location" : "/tmp",
"writable" : true,
"defaultInputFormat" : null,
"allowAccessOutsideWorkspace" : false
},
"root" : {
"location" : "/",
"writable" : false,
"defaultInputFormat" : null,
"allowAccessOutsideWorkspace" : false
}
},
"formats" : {
"psv" : {
"type" : "text",
"extensions" : [ "tbl" ],
"delimiter" : "|"
},
"csv" : {
"type" : "text",
"extensions" : [ "csv" ],
"delimiter" : ","
},
"tsv" : {
"type" : "text",
"extensions" : [ "tsv" ],
"delimiter" : "\t"
},
"parquet" : {
"type" : "parquet"
},
"json" : {
"type" : "json",
"extensions" : [ "json" ]
},
"avro" : {
"type" : "avro"
},
"sequencefile" : {
"type" : "sequencefile",
"extensions" : [ "seq" ]
},
"csvh" : {
"type" : "text",
"extensions" : [ "csvh" ],
"extractHeader" : true,
"delimiter" : ","
}
},
"enabled" : true
}
Any suggestions on how to get this working ?