Connector for DynamoDB #302

Activity

1. n-riesco

   added

   community

   enhancement

   good first issue

   on Dec 13, 2017
2. n-riesco commented on Dec 13, 2017

   

   n-riesco

   on Dec 13, 2017

   Last edited by n-riesco

   Contributor

   More actions

   We are already using https://www.npmjs.com/package/aws-sdk to implement the S3 connector, and aws-sdk supports DynamoDB. So this is definitely doable.

   I'm going to label this one as community and good first issue.

   Some useful links:

   • http://docs.aws.amazon.com/sdk-for-javascript/v2/developer-guide/dynamodb-example-query-scan.html
   • https://aws.amazon.com/blogs/aws/dynamodb-local-for-desktop-development/
3. n-riesco commented on Apr 17, 2018

   

   n-riesco

   on Apr 17, 2018

   Contributor

   More actions

   From slack:

   @shannonlal When you have 2 minutes can you have a look at this DynamoDB library (https://www.npmjs.com/package/@awspilot/dynamodb-sql). Seems like a DynamoDB SQL library. If I could just use this library I could probably throw together something for DynamoDB.

   I had a quick look at dynamodb-sql. It looks OK. I've only noticed 2 difficulties:

   1. the implementation of SHOW TABLES doesn't account for databases with 100+ tables (we'd have to contribute a PR; see https://github.com/awspilot/dynamodb-sql/blob/b6270798f74e480721b0a06d169006017e591c85/lib/dynamodb.js#L31-L38)

   2. to implements schemas(), we'd have to make multiple queries: first to request the list of tables (listTables), and then, for each table, a query to describe the table ('describeTable').
4. n-riesco commented on Apr 17, 2018

   

   n-riesco

   on Apr 17, 2018

   Contributor

   More actions

   https://docs.aws.amazon.com/amazondynamodb/latest/APIReference/API_ListTables.html
   https://docs.aws.amazon.com/amazondynamodb/latest/APIReference/API_DescribeTable.html
5. n-riesco commented on Apr 17, 2018

   

   n-riesco

   on Apr 17, 2018

   Contributor

   More actions

   :( Maybe, I'm misreading this, but it looks like dynamo-sql doesn't account for queries that return large responses and require pagination.