Merge with Dev branch #385

avagraw · 2021-06-29T23:10:07Z

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact [email protected] with any additional questions or comments.

Thank you for contributing to the IoT extension!

This checklist is used to make sure that common guidelines for a pull request are followed.

General Guidelines

If introducing new functionality or modified behavior, are they backed by unit and integration tests?
In the same context as above are command names and their parameter definitions accurate? Do help docs have sufficient content?
Have all unit and integration tests passed locally? i.e. pytest <project root> -vv
Have static checks passed using the .pylintrc and .flake8 rules? Look at the CI scripts for example usage.
Have you made an entry in HISTORY.rst which concisely explains your feature or change?

…ure#341) * Introducing IoT Hub dataplane RBAC support. * IoT Hub rbac support for most commands. * Removed deprecated nested IoT edge artifacts. * Removed deprecated show-connection-string artifacts. * --auth-type supports configurable defaults. * Improved IoT Hub test infrastructure. * Significant refactor of IoT Hub tests. * Various additional improvements. * All warnings from tests are now shown. * Uamqp integration with jwt auth. * Modify HISTORY.rst

* add support for v1 and preview routes * update history file * address review comments * lint fixes

) * Add warning for qos deprecation and update contributing guide * removing version from deprecate_info * Integration tests command update in Contributing guide

…evice_client_integration

* remove preview tags * history updates

…#344) * Fix for new identity parameter format * test updates * better differentiation of storage vars * updated to remove *all* user-identitites after storage tests until CLI core is patched

* pr comments * update dt reset to only support deleting both * Remove unused import

* Remove hiding of warnings from sample pytest.ini

* update to use wait * fix error status code * int testing * update help

…o device_client_integration

* initial changes * update params, help * add missing module to test * Word change

* Pipeline updates Added nightly build pipeline Added template to run tests against minimum supported AZ CLI * Pipeline parameter refactoring * Moved deprecated ubuntu images to `ubuntu-latest` Co-authored-by: Paymaun <[email protected]>

…o device_client_integration

* Only system module content is validated by default. * The target schema used is with respect to "schemaVersion" in "properties.desired". * Any schema defintion processing issues will skip validation.

digimaun · 2021-06-30T00:26:25Z

azext_iot/tests/__init__.py

@@ -80,6 +80,13 @@ def __init__(self, test_scenario, entity_name, entity_rg):
        self.entity_rg = entity_rg

        super(IoTLiveScenarioTest, self).__init__(test_scenario)
+
+        self.cmd(


This will considerably slow down inner dev loop when you are iterating on code and executing IT's against your changes, then having to wait each time for the long-running operation of creating an IoT Hub to finish. Ideally the tests harness can be flexible to use an existing target hub if desired, or provision a new one to run tests against.

* generate sas token with all parsers * style fixes * update param, parser enum * updates with respect to pr * updated error message

avagraw · 2021-07-01T10:29:42Z

/azp run

azure-pipelines · 2021-07-01T11:00:17Z

Azure Pipelines successfully started running 1 pipeline(s).

avagraw · 2021-07-01T11:24:48Z

Integration tests pass:

* Introducing IoT Hub dataplane RBAC support + various improvements (Azure#341) * Introducing IoT Hub dataplane RBAC support. * IoT Hub rbac support for most commands. * Removed deprecated nested IoT edge artifacts. * Removed deprecated show-connection-string artifacts. * --auth-type supports configurable defaults. * Improved IoT Hub test infrastructure. * Significant refactor of IoT Hub tests. * Various additional improvements. * All warnings from tests are now shown. * Uamqp integration with jwt auth. * Modify HISTORY.rst * Iotc command versioning (Azure#340) * add support for v1 and preview routes * update history file * address review comments * lint fixes * Add warning for qos deprecation and update contributing guide (Azure#342) * Add warning for qos deprecation and update contributing guide * removing version from deprecate_info * Integration tests command update in Contributing guide * Integrate TQDM to show progress bar when simulator sends d2c messages * remove unused loop varable * Update progress bar descriptionb * Iotc command ga (Azure#348) * remove preview tags * history updates * Use enum value instead of literal str. (Azure#349) * Managed identity support for device-identity import and export (Azure#344) * Fix for new identity parameter format * test updates * better differentiation of storage vars * updated to remove *all* user-identitites after storage tests until CLI core is patched * Update azext_metadata.json (Azure#351) * Increment version to v0.10.13 * Update README.md * Update HISTORY.rst * update twin reported properties during simulation * update unit tests * Add dataplane reset (Azure#352) * pr comments * update dt reset to only support deleting both * Remove unused import * styling updates * C2D messaging improvements. (Azure#354) * Remove hiding of warnings from sample pytest.ini * Digital Twin wait commands (Azure#345) * update to use wait * fix error status code * int testing * update help * Add Identity Storage Account ID param to sentinel values (Azure#355) * Using SDK Listener for Twin properties update * Module identity renew key (Azure#356) * initial changes * update params, help * add missing module to test * Word change * Update README.md * merge from remote * Pipeline updates (Azure#359) * Pipeline updates Added nightly build pipeline Added template to run tests against minimum supported AZ CLI * Pipeline parameter refactoring * Moved deprecated ubuntu images to `ubuntu-latest` Co-authored-by: Paymaun <[email protected]> * Structured mqtt formatting and eliminate dependency on six * remove indent property not needed any more * Check for conditionals before running test jobs (Azure#363) * Update d2c and simulate commands to return errors for non SaS devices - update help to reflect the change (Azure#346) * Add warning for qos deprecation and update contributing guide * removing version from deprecate_info * Integration tests command update in Contributing guide * Update help message for d2c command and mqtt simulation to indicate only sas auth is supported * Checks and error messages when non SAS devices are used for MQTT operations * Indentation update in help file * fix styling * Adding enum and updating test * Addressed comments * Support C2D Message decoding and Add TQDM for HTTP simulation * Update MQTT operations to run on web sockets * Remove duplicate test already in dev branch * Device connection is automatic now * Styling update * Update simulate message (Azure#371) IoTHub is not a MQTT Broker * Make gitHubConnection a variable. (Azure#373) * Iotc updates (Azure#368) * initial commit * add integration tests. * history file update. lint fixes * history updates * Update HISTORY.rst * address review comments Co-authored-by: Ryan K <[email protected]> * Feature to support setting twin reported properties during simulation * Remove extra quote * update twin reported properties during simulation * update unit tests * styling updates * Using SDK Listener for Twin properties update * Support C2D Message decoding and Add TQDM for HTTP simulation * Merging changes * Edge deployment validation changes. (Azure#382) * Only system module content is validated by default. * The target schema used is with respect to "schemaVersion" in "properties.desired". * Any schema defintion processing issues will skip validation. * Couple linter fixes. (Azure#384) * Separate IoT Hub per test suite to enable parallel test execution * lint fixes * Extend generate token (Azure#375) * generate sas token with all parsers * style fixes * update param, parser enum * updates with respect to pr * updated error message * Roll pipeline ubuntu versions back to Ubuntu-16.04 (Azure#386) * Reverting changes to submit a PR for merge with dev branch * indent fix Co-authored-by: Paymaun <[email protected]> Co-authored-by: valluriraj <[email protected]> Co-authored-by: Ryan K <[email protected]> Co-authored-by: Paymaun Heidari <[email protected]> Co-authored-by: vilit1 <[email protected]> Co-authored-by: Ricardo Minguez (Rido) <[email protected]>

digimaun and others added 30 commits May 17, 2021 14:51

Iotc command versioning (Azure#340)

624d849

* add support for v1 and preview routes * update history file * address review comments * lint fixes

Add warning for qos deprecation and update contributing guide (Azure#342

4bf999a

) * Add warning for qos deprecation and update contributing guide * removing version from deprecate_info * Integration tests command update in Contributing guide

Integrate TQDM to show progress bar when simulator sends d2c messages

b45c7f5

remove unused loop varable

72df955

Update progress bar descriptionb

1714e84

Merge remote-tracking branch 'other/device_client_integration' into d…

43160ec

…evice_client_integration

Iotc command ga (Azure#348)

b268dbe

* remove preview tags * history updates

Use enum value instead of literal str. (Azure#349)

a4baacb

Managed identity support for device-identity import and export (Azure…

79bf6cb

…#344) * Fix for new identity parameter format * test updates * better differentiation of storage vars * updated to remove *all* user-identitites after storage tests until CLI core is patched

Update azext_metadata.json (Azure#351)

616e2c0

Increment version to v0.10.13

9ee1ddc

Update README.md

3f12f21

Update HISTORY.rst

058648a

update twin reported properties during simulation

5a251d9

update unit tests

70f806f

Add dataplane reset (Azure#352)

759503a

* pr comments * update dt reset to only support deleting both * Remove unused import

styling updates

f4333a9

C2D messaging improvements. (Azure#354)

f82ef12

* Remove hiding of warnings from sample pytest.ini

Digital Twin wait commands (Azure#345)

48af558

* update to use wait * fix error status code * int testing * update help

Add Identity Storage Account ID param to sentinel values (Azure#355)

354a98d

Using SDK Listener for Twin properties update

0e983b8

Merge remote-tracking branch 'upstream/device_client_integration' int…

21e2370

…o device_client_integration

Module identity renew key (Azure#356)

b498a60

* initial changes * update params, help * add missing module to test * Word change

Update README.md

72fa744

merge from remote

e9f8803

Pipeline updates (Azure#359)

2ef0a41

* Pipeline updates Added nightly build pipeline Added template to run tests against minimum supported AZ CLI * Pipeline parameter refactoring * Moved deprecated ubuntu images to `ubuntu-latest` Co-authored-by: Paymaun <[email protected]>

Merge remote-tracking branch 'upstream/device_client_integration' int…

3b1ded1

…o device_client_integration

Structured mqtt formatting and eliminate dependency on six

d4fb875

remove indent property not needed any more

1e9ada4

avagraw and others added 12 commits June 22, 2021 16:54

Merging with upstream

2c0ba67

Remove extra quote

bbb82ca

update twin reported properties during simulation

54a46e5

update unit tests

b7d9d12

styling updates

1487c1f

Using SDK Listener for Twin properties update

782e34b

Support C2D Message decoding and Add TQDM for HTTP simulation

a588704

Merging changes

a15c8a0

Merge remote-tracking branch 'upstream/device_client_integration' int…

0ae6dab

…o device_client_integration

Edge deployment validation changes. (Azure#382)

a2adb11

* Only system module content is validated by default. * The target schema used is with respect to "schemaVersion" in "properties.desired". * Any schema defintion processing issues will skip validation.

Couple linter fixes. (Azure#384)

81c1153

Separate IoT Hub per test suite to enable parallel test execution

6dbae11

avagraw requested a review from digimaun as a code owner June 29, 2021 23:10

lint fixes

4c14f9e

avagraw changed the title ~~Device client integration~~ Enable parallel execution of integration tests and update init reported properties logic Jun 29, 2021

digimaun reviewed Jun 30, 2021

View reviewed changes

vilit1 and others added 3 commits June 30, 2021 10:46

Extend generate token (Azure#375)

5b30336

* generate sas token with all parsers * style fixes * update param, parser enum * updates with respect to pr * updated error message

Roll pipeline ubuntu versions back to Ubuntu-16.04 (Azure#386)

fdcdfbe

Merging with dev

71b1f37

avagraw requested a review from valluriraj as a code owner June 30, 2021 23:28

Reverting changes to submit a PR for merge with dev branch

c9e6e27

avagraw changed the title ~~Enable parallel execution of integration tests and update init reported properties logic~~ Merge with Dev branch Jul 1, 2021

indent fix

7ff9830

digimaun approved these changes Jul 1, 2021

View reviewed changes

avagraw merged commit 1c30b64 into Azure:device_client_integration Jul 1, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Merge with Dev branch #385

Merge with Dev branch #385

avagraw commented Jun 29, 2021

digimaun Jun 30, 2021

avagraw commented Jul 1, 2021

azure-pipelines bot commented Jul 1, 2021

avagraw commented Jul 1, 2021

Merge with Dev branch #385

Merge with Dev branch #385

Conversation

avagraw commented Jun 29, 2021

General Guidelines

digimaun Jun 30, 2021

Choose a reason for hiding this comment

avagraw commented Jul 1, 2021

azure-pipelines bot commented Jul 1, 2021

avagraw commented Jul 1, 2021