Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LG-261: MicroProfile Metrics 2.3 Implementation #9985

Closed
donbourne opened this issue Dec 2, 2019 · 17 comments
Closed

LG-261: MicroProfile Metrics 2.3 Implementation #9985

donbourne opened this issue Dec 2, 2019 · 17 comments
Assignees
Labels
beta:20200 Design Approved Epic Used to track Feature Epics that are following the UFO process FAT complete This label is not part of the feature process and will be deleted. Use `target:ga` label instead. focalApproved:accessibility Focal Approval granted for Accessibility for the feature focalApproved:demo Approval that a Demo has been scheduled focalApproved:fat Focal Approval granted for FAT for the feature focalApproved:globalization Focal Approval granted for Globalization for the feature focalApproved:id Focal Approval granted for ID for the feature focalApproved:performance Focal Approval granted for Performance for the feature focalApproved:serviceability Focal Approval granted for Serviceability for the feature focalApproved:ste Focal Approval granted for STE for the feature focalApproved:svt Focal Approval granted for SVT for the feature in:MicroProfile/Metrics release:20004 ReleaseCheckListAdded SVT Required target:20004 team:Lumberjack

Comments

@donbourne
Copy link
Member

donbourne commented Dec 2, 2019

LG-261 follow from LG-262 (SPEC + API + TCK) regarding the MicroProfile Metrics 2.3 release

The MicroProfile Metrics 2.3 release includes two new major features:

  1. New metric SimpleTimer (@SimplyTimed)
  • Light-weight alternative to the existing Timer metric; only tracks and reports values regarding total elapsed time and invocation count
  1. Metrics derived from tracking REST resource method usage (GET, POST, PUT,DELETE, OPTIONS,PATCH,HEAD)
  • Backed by the SimpleTimer metric it will track elapsed time duration and invocation count
  • Enabled with use of JAX-RS 2.1 (and if JAXRS methods are used). We will leverage the JAX-RS filter tracking used in APSFOUND-56

As as consequence of the second (REST metric) feature , mpMetrics-2.3 will now depend on monitor-1.0 feature.

WAD/UFO : https://ibm.ent.box.com/file/602205571172

@donbourne donbourne added team:Lumberjack Epic Used to track Feature Epics that are following the UFO process labels Dec 2, 2019
@donbourne donbourne changed the title MicroProfile Metrics 2.3 Implementation LG-261: MicroProfile Metrics 2.3 Implementation Dec 2, 2019
@Channyboy Channyboy self-assigned this Dec 18, 2019
@donbourne donbourne added the In Progress Items that are in active development. label Jan 27, 2020
@atosak
Copy link

atosak commented Jan 28, 2020


List of Steps to complete or get approvals / sign-offs for Onboarding to the Liberty release (GM date)

Instructions:

  • Do the actions below and mark them complete in the checklist when they are done.
  • Make sure all feature readiness approvers put the appropriate tag on the epic to indicate their approval.

TARGET COMPLETION DATE Before Development Starts or 8 weeks before Onboarding

  • POC Design / WAD Review Scheduled (David Chang) or N/A.
  • POC Design / WAD Reviewed (Feature Owner) or N/A.
  • Complete any follow-ons from the POC Review.
  • Design / WAD Approval (Alasdair Nottingham) or N/A.
  • No Design / No WAD Approval (Arthur De Magalhaes - cloud / Alasdair Nottingham - server) or N/A.
  • SVT Requirements identified. (Epic owner / Feature owner with SVT focal point)
  • ID Requirements identified. (Epic owner / Feature owner with ID focal point)
  • Create a child task of the epic entitled "FAT Approval Test Summary". Add and fill in the template as described here: https://github.ibm.com/was-liberty/WS-CD-Open/wiki/Feature-Review-(Feature-Test-Summary-Process)

TARGET COMPLETION DATE 3 weeks before Onboarding

  • Identify all open source libraries that are changing or are new. Work with Legal Release Services (Cass Tucker or Release PM) to get open source cleared and approved. Or N/A. (Epic Owner). New or changed open source impacts license and Certificate of Originality.

TARGET COMPLETION DATE ** 3 weeks before Onboarding**

  • All new or changed PII messages are checked into the integration branch, before the last translation shipment out. (Epic Owner)

TARGET COMPLETION DATE 2 weeks before Onboarding

  • Implementation complete. (Epic owner / Feature owner)
  • All function tests complete. Ready for FAT Approval. (Epic owner / Feature owner)
  • Review all known issues for Stop Ship. (Epic owner / Feature owner / PM)

APPROVALS with TARGET COMPLETION DATE 2 to 1 week before Onboarding

Prereq: You must have the Design Approved or No Design Approved label on the GitHub Epic.

  • Accessibility - (G Scott Johnston). Accessibility testing is complete or N/A. Approver adds label focalApproved:accessibility to the Epic in Github.
  • FAT Liberty SOE - (Kevin Smith). SOE FATS are running successfully or N/A . Approver adds label focalApproved:fat to the Epic in Github.
  • Globalization (Sam Wong - Liberty / Simy Cheeran - tWAS). Translation is complete or N/A. TVT - complete or N/A. Approver adds label focalApproved:globalization to the Epic in Github.
  • ID - (Kareen Deen). Documentation work is complete or N/A . Approver adds label focalApproved:id to the Epic in Github.
  • Performance - (Jared Anderson). Performance testing is complete with no high severity defects or N/A . Approver adds label focalApproved:performance to the Epic in Github.
  • Serviceability - (Don Bourne). Serviceability has been addressed.
  • STE - (Swati Kasundra). STE chart deck is complete or N/A . Approver adds label focalApproved:ste to the Epic in Github.
  • SVT - (Greg Ecock - Cloud, Brian Hanczaryk- APS). SVT is complete or N/A . Approver adds label focalApproved:svt to the Epic in Github.
  • Demo - (Liberty only - Tom Evans or Chuck Bridgham). Demo is scheduled for an upcoming EOI. Approver adds label focalApproved:demo to the Epic in Github.

TARGET COMPLETION DATE 1 week before Onboarding

  • No Stop Ship issues for the feature. (Epic owner / Feature owner / Release PM)
  • Ship Readiness Review and Release Notes completed (Epic owner / Feature owner / Release PM)
  • Github Epic and Epic's issues are closed / complete. All PRs are committed to the master branch. (Epic owner / Feature owner / Backlog Subtribe PM)

NOT REQUIRED FOR A FEATURE

  • OL Guides - (Yee-Kang Chang). Assessment for OL Guides is complete or N/A.
  • WDT - (Leonard Theivendra). WDT work complete or N/A.

Related Deliverables TARGET COMPLETION DATE General Availability

  • Blog article writeup (Epic owner / Feature owner / Laura Cowen)

@Channyboy
Copy link
Contributor

Channyboy commented Feb 24, 2020

Publicly available link:
https://ibm.box.com/s/4vmex4gxj28y74s4grnn7p0hczrr4105

@OpenLiberty OpenLiberty deleted a comment from Channyboy Feb 24, 2020
@NottyCode
Copy link
Member

Feedback on design:

  1. Please use the new design template for future designs
  2. Slide 26 uses rest.request but earlier and later in the deck it uses REST.request, is this correct or is it a typo
  3. Slide 28 references installUtility which doesn't exist in Open Liberty so should not be there.
  4. Slide 29, the first bullet is likely unnecessary.
  5. Slide 35, I would prefer to see some statement about the performance effect rather than "it will have one" are we talking 5%, 10% more? Is anything being done to address this? It should be clear that this is vs the mpMetrics-3.2 feature and isn't a degradation in performance for an existing feature.
  6. Slide 36 doesn't talk about servicability, it talks about mitigating an unqualified performance impact, so really should be on slide 35.

@Channyboy
Copy link
Contributor

Channyboy commented Mar 5, 2020

@samwatibm Hi Sam, translation files have been merged. May you approve for globalization.

@Channyboy
Copy link
Contributor

Channyboy commented Mar 5, 2020

@chirp1
Doc issues are opened with this item:
OpenLiberty/docs#1109
AND
https://github.ibm.com/was-liberty/liberty-docs/issues/1790

May you approve for ID.

@samwatibm samwatibm added the focalApproved:globalization Focal Approval granted for Globalization for the feature label Mar 5, 2020
@Channyboy Channyboy added the target:ga The Epic is ready for focal approvals, after which it can GA. label Mar 5, 2020
@Channyboy
Copy link
Contributor

@sabolo May you review?
Feature Test Summary: #10946

@Channyboy
Copy link
Contributor

Channyboy commented Mar 6, 2020

@donbourne
Serviceability Approval Comment - Please answer the following questions for serviceability approval:

  1. UFO -- does the UFO identify the most likely problems customers will see and identify how the feature will enable them to diagnose and solve those problems without resorting to raising a PMR? Have these issues been addressed in the implementation?

N/A - no problems expected to be encountered with new metric and metric data. Underlying logic behaves the same as other existing metrics (i.e registration, retrieval and export/display).

  1. Test and Demo -- As part of the serviceability process we're asking feature teams to test and analyze common problem paths for serviceability and demo those problem paths to someone not involved in the development of the feature (eg. L2, test team, or another development team).
    a) What problem paths were tested and demonstrated?
    b) Who did you demo to?
    c) Do the people you demo'd to agree that the serviceability of the demonstrated problem scenarios is sufficient to avoid PMRs for any problems customers are likely to encounter, or that L2 should be able to quickly address those problems without need to engage L3?

N/A - no problems expected to be encountered with new metric and metric data. Underlying logic behaves the same as other existing metrics (i.e registration, retrieval and export/display).

  1. SVT -- SVT team is often the first team to try new features and often encounters problems setting up and using them. Note that we're not expecting SVT to do full serviceability testing -- just to sign-off on the serviceability of the problem paths they encountered.

a) Who conducted SVT tests for this feature?
Andrew Reider and Tanya Kulik

b) Do they agree that the serviceability of the problems they encountered is sufficient to avoid PMRs, or that L2 should be able to quickly address those problems without need to engage L3?
Yes.

I agree with 3b for mpMetrics-2.3 , on the basis that the new feature is similar in complexity to the previous version with regard to problem resolution. Both versions are publicly documented (and most of it is the same), so developers/clients using either can potentially resolve issues on their own or using solutions that worked for version 2.2

Which L2 / L3 queues will handle PMRs for this feature? Ensure they are present in the contact reference file and in the queue contact summary, and that the respective L2/L3 teams know they are supporting it. Ask Don Bourne if you need links or more info.

WAS L3: Liberty Log Analytics

@Channyboy
Copy link
Contributor

@tevans78 Demo is scheduled for Liberty 20.5 - March 10th EOI.

@skasund
Copy link

skasund commented Mar 6, 2020

L2 has requested STE slides for this feature. The STE template can be found at the link below. You can use either one to create the education.

Slide Template: https://ibm.box.com/s/1an42g7zdgmaj84w7dft0indqfgi8ffm

Github Template: https://pages.github.ibm.com/WASL3/site/STE/about

Please upload the completed slides to the same STE Archive BOX folder. Thanks!

@Channyboy
Copy link
Contributor

@skasund STE slide here : https://ibm.ent.box.com/file/629590802249

@skasund skasund added the focalApproved:ste Focal Approval granted for STE for the feature label Mar 6, 2020
@skasund
Copy link

skasund commented Mar 6, 2020

@Channyboy Thanks for the slides. I've approved the feature.

@donbourne donbourne added the focalApproved:serviceability Focal Approval granted for Serviceability for the feature label Mar 8, 2020
@chirp1
Copy link
Contributor

chirp1 commented Mar 9, 2020

The writers are working down a prioritized backlog. As I mentioned to David Chan, the doc updates for OL likely won't be made by the time 20.0.0.4 goes out. David will have a GA log post for the Epic. Approving.

@chirp1 chirp1 added the focalApproved:id Focal Approval granted for ID for the feature label Mar 9, 2020
@tevans78 tevans78 added the focalApproved:demo Approval that a Demo has been scheduled label Mar 9, 2020
@Channyboy Channyboy added the FAT complete This label is not part of the feature process and will be deleted. Use `target:ga` label instead. label Mar 11, 2020
@dave-waddling dave-waddling added the focalApproved:fat Focal Approval granted for FAT for the feature label Mar 12, 2020
@Channyboy
Copy link
Contributor

mpMetrics-2.3 moved to GA
See https://github.com/OpenLiberty/open-liberty/pulls?q=is%3Apr+tevan+is%3Aclosed
closing.

@samwatibm samwatibm added release:20004 and removed target:ga The Epic is ready for focal approvals, after which it can GA. labels Apr 2, 2020
@atosak atosak removed the In Progress Items that are in active development. label May 14, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
beta:20200 Design Approved Epic Used to track Feature Epics that are following the UFO process FAT complete This label is not part of the feature process and will be deleted. Use `target:ga` label instead. focalApproved:accessibility Focal Approval granted for Accessibility for the feature focalApproved:demo Approval that a Demo has been scheduled focalApproved:fat Focal Approval granted for FAT for the feature focalApproved:globalization Focal Approval granted for Globalization for the feature focalApproved:id Focal Approval granted for ID for the feature focalApproved:performance Focal Approval granted for Performance for the feature focalApproved:serviceability Focal Approval granted for Serviceability for the feature focalApproved:ste Focal Approval granted for STE for the feature focalApproved:svt Focal Approval granted for SVT for the feature in:MicroProfile/Metrics release:20004 ReleaseCheckListAdded SVT Required target:20004 team:Lumberjack
Projects
None yet
Development

No branches or pull requests