From 269432226c65b0b4006028133302c95c4e40f427 Mon Sep 17 00:00:00 2001 From: Sumi <111455374+sumiat@users.noreply.github.com> Date: Mon, 16 Oct 2023 17:13:41 -0700 Subject: [PATCH 1/6] Create 2023-10-16-email-marketing draft started a draft of the email marketing ADR --- .../decisions/adr/2023-10-16-email-marketing | 142 ++++++++++++++++++ 1 file changed, 142 insertions(+) create mode 100644 documentation/decisions/adr/2023-10-16-email-marketing diff --git a/documentation/decisions/adr/2023-10-16-email-marketing b/documentation/decisions/adr/2023-10-16-email-marketing new file mode 100644 index 000000000..37acc89f4 --- /dev/null +++ b/documentation/decisions/adr/2023-10-16-email-marketing @@ -0,0 +1,142 @@ +# Communications Tooling: Email Marketing + +- **Status:** Draft +- **Last Modified:** 2023-10-16 +- **Related Issue:** [#590](https://github.com/HHS/grants-equity/issues/590) +- **Deciders:** Lucas Brown, Aaron Couch, Billy Daly, Sarah Knopp, Sumi Thaiveettil +- **Tags:** communucations, open source, email marketing + +## Context and Problem Statement + + +## Decision Drivers + +#### Must Have + +- **Usability:** Non-technical users should be able to access and create content with minimal training or guidance. +- **Content Review:** Collaborators should be able to review and edit draft content before emails are sent out. +- **Comments:** Reviewers should be able to leave in-line comments on content that they are reviewing. +- **Internationalization (i18n):** The solution should provide support for displaying content in multiple languages. +- **Analytics:** The platform should provide support for tracking open rates, click-through-rate and other other web analytics. +- **Onboarding Costs:** Onboarding new members to the platform should be relatively inexpensive, both in terms of staff time/resources and direct costs (e.g. licensing fees). +- **Maintenance Costs:** It should not be prohibitively expensive to maintain the email marketing tool, both in terms of staff time/resources and direct costs (e.g. hosting fees). +- **Authority to Operate (ATO):** The tool should be FedRAMPed or have an Authority to Operate as it will have names and email addresses of public users. + +#### Nice to Have + +- **Open Source:** The tool used to manage the email marketing content should be open source, if possible. + +## Options Considered + + +- [Sendy](Sendy) - +- [Pardot](Pardot) - +- [MailChimp](MailChimp) - +- [Hubspot](Hubspot) - +- [Mautic](Mautic) - + +## Decision Outcome + + + +### Positive Consequences + + + +### Negative Consequences + + + +### Back-up Options + + + +## Comparison Matrix + +- ✅ Feature available, meets requirement +- ❌ Feature not available, does not meet requirement +- 🔄 Partial feature, limited feature availability, feature in progress or undergoing improvements +- 1-3 Strength level +- ❓Unknown + + + +## Pros and Cons of the Options + +### Sendy + + + +#### Details + + + +#### Pros + + +#### Cons + + + +### Pardot + + +#### Details + + + +#### Pros + + + +#### Cons + + + +### MailChimp + + +#### Details + + + +#### Pros + + +#### Cons + + + +### Hubspot + + + +#### Details + + + +#### Pros + + + +#### Cons + + + +### Mautic + + + +#### Details + + + +#### Pros + + + +#### Cons + + +## Links + From e415b217ba7ad310497e75ae4e0a768125650bab Mon Sep 17 00:00:00 2001 From: Sumi <111455374+sumiat@users.noreply.github.com> Date: Wed, 1 Nov 2023 15:37:49 -0700 Subject: [PATCH 2/6] [Issue #590] Updates to ADR not ready for review yet, still draft format. --- .../decisions/adr/2023-10-16-email-marketing | 21 +++++++++++++------ 1 file changed, 15 insertions(+), 6 deletions(-) diff --git a/documentation/decisions/adr/2023-10-16-email-marketing b/documentation/decisions/adr/2023-10-16-email-marketing index 37acc89f4..95bc37294 100644 --- a/documentation/decisions/adr/2023-10-16-email-marketing +++ b/documentation/decisions/adr/2023-10-16-email-marketing @@ -8,6 +8,7 @@ ## Context and Problem Statement +An email marketing tool is primarily used for creating, sending, and tracking email campaigns to a list of subscribers. It allows for us to engage with our audience, push notifications and newsletters to our users, share information, and build customer relationships through email. ## Decision Drivers @@ -25,15 +26,17 @@ #### Nice to Have - **Open Source:** The tool used to manage the email marketing content should be open source, if possible. +- **Community & Support**: The platform has a strong community for ongoing support, updates, and bug fixes +- **Scalability**: The platform should be able to hadndle a growing number of subscribers without performance issues ## Options Considered -- [Sendy](Sendy) - -- [Pardot](Pardot) - -- [MailChimp](MailChimp) - -- [Hubspot](Hubspot) - -- [Mautic](Mautic) - +- [Sendy](https://sendy.co/) +- [Salesforce Marketing](https://www.salesforce.com/products/engagement-marketing/) - +- [MailChimp](https://mailchimp.com/) +- [Hubspot](https://www.hubspot.com/) +- [Mautic](https://www.mautic.org/) ## Decision Outcome @@ -73,12 +76,18 @@ #### Pros +- Sendy is currently used by HHS and it would be simple for existing users to start using the tool right away +- It provides great metrics and analytics +- HHS is able to send a few campaigns simultaneously +- Sendy is self-hosted which means we have control over the email list and the data. Sendy is a self hosted application that runs on our own web server. Pay once and it's yours, there's no recurring fee. #### Cons +- Campaigns with larged audiences or number of emails take a long time to send and a user cannot use the tool while an email is being sent. Currently, we have 1M subscribers and it takes a long time to send to that many subscribers -### Pardot + +### Salesforce Marketing #### Details From 3a94664b17ccff4e49c18071f03bdec909dd7fc7 Mon Sep 17 00:00:00 2001 From: Sumi <111455374+sumiat@users.noreply.github.com> Date: Wed, 1 Nov 2023 15:38:14 -0700 Subject: [PATCH 3/6] [Issue #590] md format --- .../{2023-10-16-email-marketing => 2023-10-16-email-marketing.md} | 0 1 file changed, 0 insertions(+), 0 deletions(-) rename documentation/decisions/adr/{2023-10-16-email-marketing => 2023-10-16-email-marketing.md} (100%) diff --git a/documentation/decisions/adr/2023-10-16-email-marketing b/documentation/decisions/adr/2023-10-16-email-marketing.md similarity index 100% rename from documentation/decisions/adr/2023-10-16-email-marketing rename to documentation/decisions/adr/2023-10-16-email-marketing.md From c7b99a1291731dd25450f07edd965035a006a86d Mon Sep 17 00:00:00 2001 From: Sumi <111455374+sumiat@users.noreply.github.com> Date: Thu, 16 Nov 2023 16:29:47 -0800 Subject: [PATCH 4/6] [Issue 590] ADR - Email Marketing Tool Email marketing tool ADR --- .../adr/2023-10-16-email-marketing.md | 96 +++++++++++++++---- 1 file changed, 80 insertions(+), 16 deletions(-) diff --git a/documentation/decisions/adr/2023-10-16-email-marketing.md b/documentation/decisions/adr/2023-10-16-email-marketing.md index 95bc37294..130a75425 100644 --- a/documentation/decisions/adr/2023-10-16-email-marketing.md +++ b/documentation/decisions/adr/2023-10-16-email-marketing.md @@ -37,22 +37,25 @@ An email marketing tool is primarily used for creating, sending, and tracking em - [MailChimp](https://mailchimp.com/) - [Hubspot](https://www.hubspot.com/) - [Mautic](https://www.mautic.org/) +- [Adobe Campaign](https://business.adobe.com/products/campaign/adobe-campaign.html) ## Decision Outcome +The suggested approach is to utilize Sendy and create a campaign for Simpler Grants.gov within the existing main account, leveraging existing knowledge and allowing for faster use. This allows for a faster initiation of the process. One of the most important criteria given by users of the tool, the Grants.gov Communications team, is the need to be able to send an email to the current 1M current subscribers quickly which Sendy cannot do. There are other limitations of this solution so we recommend that we select a back-up option email marketing solution for our long-term needs. -### Positive Consequences +### Open Questions +1. Can we transfer the Simpler Grants.gov email list to a different tool in the future? -### Negative Consequences + TODO ### Back-up Options - +Alternatively, as a backup solution, Mautic is a cost-effective and customizable option that can handle growing subscribers. Being an open-source platform, it comes with a slightly steeper learning curve. However, since only a limited number of individuals will be using the tool, we can provide training to facilitate a smooth onboarding process. ## Comparison Matrix @@ -62,29 +65,46 @@ An email marketing tool is primarily used for creating, sending, and tracking em - 1-3 Strength level - ❓Unknown +| Factor | Sendy | Salesforce | MailChimp | Hubspot | Mautic | Adobe | +| --------------------------- | :---: | :--------: | :-------: | :-----: | :----: | :---: | +| Usability | 2 | 1 | 3 | 3 | 1 | 3 | +| Content Review | 🔄 | ✅ | ✅ | ✅ | ✅ | ✅ | +| Comments | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | +| Open source* | 🔄 | ❌ | ❌ | ❌ | ✅ | ❌ | +| Multi-Media | ✅ | ✅ | ❌ | ✅ | ✅ | 🔄 | +| Analytics | 1 | ✅ | ✅ | ✅ | ✅ | ✅ | +| Internationalization | ❓ | 2 | 3 | 2 | 1 | 1 | +| Onboarding costs | 1 | 3 | 1 | 2 | 1 | 2 | +| Community and Support* | 1 | 3 | 3 | 3 | 3 | 3 | +| Scalability | 🔄 | ✅ | ✅ | ✅ | ✅ | ❌ | +| Send 1M emails quickly | ❌ | ❓ | ❓ | ❓ | ❓ | ❓ | +| Authority to Operate or FedRAMP| ✅ | ❓ | ❌ | ❌ | ❌ | ✅ | + ## Pros and Cons of the Options ### Sendy - - #### Details - +Sendy is a self-hosted email marketing application that allows users to send newsletters, manage subscribers, and track campaign performance. It is known for its cost-effectiveness and integration with Amazon SES for efficient email delivery. #### Pros - Sendy is currently used by HHS and it would be simple for existing users to start using the tool right away -- It provides great metrics and analytics +- It provides decent metrics and analytics - HHS is able to send a few campaigns simultaneously - Sendy is self-hosted which means we have control over the email list and the data. Sendy is a self hosted application that runs on our own web server. Pay once and it's yours, there's no recurring fee. +- It is a cost-effective option as it is self-hosted. +- Self-hosting provides control over data and infrastructure #### Cons - Campaigns with larged audiences or number of emails take a long time to send and a user cannot use the tool while an email is being sent. Currently, we have 1M subscribers and it takes a long time to send to that many subscribers - +- Lacks some advanced features present in other platforms. +- It requires technical knowledge for setup and maintenance. +- Limited customer support compared to premium services. ### Salesforce Marketing @@ -92,14 +112,19 @@ An email marketing tool is primarily used for creating, sending, and tracking em #### Details +Salesforce Marketing Cloud is a comprehensive marketing automation platform that enables organizations to create and manage personalized customer journeys. It includes features for email marketing, social media advertising, customer segmentation, and analytics. #### Pros - - +- Salesforce Marketing is a comprehensive solution that offers a wide range of features and tools for marketing automation +- If we use any other Salesforce tools in the future, it is an easier integration +- It provides robust analytics and reporting capabilities #### Cons +- Salesforce Marketing can be expensive, especially for smaller businesses +- There is learning curve as it may be more complex for non-technical users +- It may have more features than needed ### MailChimp @@ -107,30 +132,39 @@ An email marketing tool is primarily used for creating, sending, and tracking em #### Details - +Mailchimp is a widely used email marketing platform that offers a user-friendly interface for designing and sending emails, managing subscriber lists, and analyzing campaign performance. It also provides marketing automation features. #### Pros +- MailChimp is user-friendly for non-technical users with a simple interface +- MailChimp does offer a free plan for small-scale needs +- There are automation features for targeted campaigns -#### Cons +#### Cons +- Pricing can become high as subscriber lists grow +- Some users may find limitations for advanced customization +- Free plan users have limited access to customer support ### Hubspot - #### Details - +HubSpot is an all-in-one inbound marketing, sales, and customer service platform. It provides tools for content marketing, social media, lead generation, and customer relationship management (CRM) to help businesses attract, engage, and delight customers. #### Pros - +- Hubspot combines marketing, sales, and customer service tools +- Intuitive interface for non-technical users +- Strong automation and personalization features #### Cons - +- Can be expensive, especially for additional features +- Some users may find it complex initially +- More features th an needed for some smaller organizations ### Mautic @@ -138,14 +172,44 @@ An email marketing tool is primarily used for creating, sending, and tracking em #### Details +Mautic is an open-source marketing automation platform that allows users to automate marketing tasks, personalize communication, and track the behavior of leads. It is known for its flexibility, open-source nature, and strong community support. + +#### Pros + +- Offers flexibility for customization +- Strong community support for ongoing development +- Can handle growing subscriber lists + +#### Cons + +- Moderate usability, some users may find it less user-friendly +- May require additional development for certain integrations +- Non-technical users might face a learning curve +### Adobe Campaign + + + +#### Details + +Adobe Campaign is a marketing automation tool that forms part of the Adobe Experience Cloud. It enables users to create, execute, and measure multi-channel marketing campaigns, including email, mobile, social, and web, while integrating with other Adobe products. + #### Pros +- Adobe Campaign is FedRAMP certified +- Adobe Campaign is part of the broader Adobe Experience Cloud which is a suite of products and could be beneficial if we use more Adobe products for marketing and analytics tools +- Enables the creation and execution of multi-channel marketing campaigns, including email, mobile, social, and web +- Offers robust features for personalizing content and creating dynamic, targeted campaigns #### Cons +- The platform may have a learning curve, especially for users new to advanced marketing automation tools +- Adobe Campaign can be relatively expensive, making it more suitable for larger enterprises with substantial marketing budgets +- Implementation and maintenance may require dedicated resources and expertise +- The extensive feature set may be more than what smaller businesses need, leading to potentially unnecessary complexity + ## Links From cc94dd9e0a7ae49b800a1afad6364ebd720f699b Mon Sep 17 00:00:00 2001 From: Sumi <111455374+sumiat@users.noreply.github.com> Date: Mon, 4 Dec 2023 10:56:10 -0800 Subject: [PATCH 5/6] [Issue #590] Email marketing tool ADR - Updated open questions and some clarifications. --- .../decisions/adr/2023-10-16-email-marketing.md | 11 +++-------- 1 file changed, 3 insertions(+), 8 deletions(-) diff --git a/documentation/decisions/adr/2023-10-16-email-marketing.md b/documentation/decisions/adr/2023-10-16-email-marketing.md index 130a75425..20837bfae 100644 --- a/documentation/decisions/adr/2023-10-16-email-marketing.md +++ b/documentation/decisions/adr/2023-10-16-email-marketing.md @@ -41,15 +41,14 @@ An email marketing tool is primarily used for creating, sending, and tracking em ## Decision Outcome -The suggested approach is to utilize Sendy and create a campaign for Simpler Grants.gov within the existing main account, leveraging existing knowledge and allowing for faster use. This allows for a faster initiation of the process. One of the most important criteria given by users of the tool, the Grants.gov Communications team, is the need to be able to send an email to the current 1M current subscribers quickly which Sendy cannot do. There are other limitations of this solution so we recommend that we select a back-up option email marketing solution for our long-term needs. - +The suggested approach is to utilize Sendy and create a campaign for Simpler Grants.gov within the existing main account for the near-term, leveraging existing knowledge and allowing for faster use. This allows for a faster initiation of the process. One of the most important criteria given by users of the tool, the Grants.gov Communications team, is the need to be able to send an email to the current 1M current subscribers quickly which Sendy cannot do. There are other limitations of this solution so we recommend that we select a back-up option email marketing solution for our long-term needs. ### Open Questions -1. Can we transfer the Simpler Grants.gov email list to a different tool in the future? +1. Can we transfer the Simpler Grants.gov email list from Sendy to a different tool in the future? - TODO +Yes, we are able to transfer the list created in Sendy to a new tool in the future. @@ -168,8 +167,6 @@ HubSpot is an all-in-one inbound marketing, sales, and customer service platform ### Mautic - - #### Details Mautic is an open-source marketing automation platform that allows users to automate marketing tasks, personalize communication, and track the behavior of leads. It is known for its flexibility, open-source nature, and strong community support. @@ -189,8 +186,6 @@ Mautic is an open-source marketing automation platform that allows users to auto ### Adobe Campaign - - #### Details Adobe Campaign is a marketing automation tool that forms part of the Adobe Experience Cloud. It enables users to create, execute, and measure multi-channel marketing campaigns, including email, mobile, social, and web, while integrating with other Adobe products. From dc7e7ff74a0463d25dee445ceb269ea505636114 Mon Sep 17 00:00:00 2001 From: Sumi <111455374+sumiat@users.noreply.github.com> Date: Mon, 4 Dec 2023 13:25:40 -0800 Subject: [PATCH 6/6] [Issue #590] ADR: Email marketing tool - updated based on comments from @lucasmbrown-usds and recent learnings --- .../adr/2023-10-16-email-marketing.md | 26 +++++++++++++------ 1 file changed, 18 insertions(+), 8 deletions(-) diff --git a/documentation/decisions/adr/2023-10-16-email-marketing.md b/documentation/decisions/adr/2023-10-16-email-marketing.md index 20837bfae..aa38e80f7 100644 --- a/documentation/decisions/adr/2023-10-16-email-marketing.md +++ b/documentation/decisions/adr/2023-10-16-email-marketing.md @@ -1,7 +1,7 @@ # Communications Tooling: Email Marketing - **Status:** Draft -- **Last Modified:** 2023-10-16 +- **Last Modified:** 2023-12-04 - **Related Issue:** [#590](https://github.com/HHS/grants-equity/issues/590) - **Deciders:** Lucas Brown, Aaron Couch, Billy Daly, Sarah Knopp, Sumi Thaiveettil - **Tags:** communucations, open source, email marketing @@ -43,6 +43,8 @@ An email marketing tool is primarily used for creating, sending, and tracking em The suggested approach is to utilize Sendy and create a campaign for Simpler Grants.gov within the existing main account for the near-term, leveraging existing knowledge and allowing for faster use. This allows for a faster initiation of the process. One of the most important criteria given by users of the tool, the Grants.gov Communications team, is the need to be able to send an email to the current 1M current subscribers quickly which Sendy cannot do. There are other limitations of this solution so we recommend that we select a back-up option email marketing solution for our long-term needs. +There are limitations to Sendy and the recommendation is to move to another email marketing tool that is a better long-term solution that works for HHS and the larger communications strategy for Simpler Grants.gov, current Grants.gov, and NOFO. This makes it easier and consistent to implement and manage one tool. + ### Open Questions @@ -50,11 +52,19 @@ The suggested approach is to utilize Sendy and create a campaign for Simpler Gra Yes, we are able to transfer the list created in Sendy to a new tool in the future. +2. What is the long-term tool that we should use? + +As we're determining the brand identity and communications strategy and how the different HHS teams will work together, we will determine the long-term solution at a later time. +3. Can we send to individual lists? + +We can use Sendy to send to individuals and also for a separate subscription lists which is called a "Brand" in Sendy. + +5. How can we integrate with the current implementation of Sendy? + +A Brand can be created under the existing Sendy account which allows users who subscribe through that form to be added to a separate list specific to Simpler.Grants.gov. This list will be distinct from the other lists within the Sendy account. -### Back-up Options -Alternatively, as a backup solution, Mautic is a cost-effective and customizable option that can handle growing subscribers. Being an open-source platform, it comes with a slightly steeper learning curve. However, since only a limited number of individuals will be using the tool, we can provide training to facilitate a smooth onboarding process. ## Comparison Matrix @@ -69,17 +79,17 @@ Alternatively, as a backup solution, Mautic is a cost-effective and customizable | Usability | 2 | 1 | 3 | 3 | 1 | 3 | | Content Review | 🔄 | ✅ | ✅ | ✅ | ✅ | ✅ | | Comments | ❌ | ✅ | ❌ | ✅ | ✅ | ✅ | -| Open source* | 🔄 | ❌ | ❌ | ❌ | ✅ | ❌ | | Multi-Media | ✅ | ✅ | ❌ | ✅ | ✅ | 🔄 | | Analytics | 1 | ✅ | ✅ | ✅ | ✅ | ✅ | | Internationalization | ❓ | 2 | 3 | 2 | 1 | 1 | | Onboarding costs | 1 | 3 | 1 | 2 | 1 | 2 | -| Community and Support* | 1 | 3 | 3 | 3 | 3 | 3 | -| Scalability | 🔄 | ✅ | ✅ | ✅ | ✅ | ❌ | | Send 1M emails quickly | ❌ | ❓ | ❓ | ❓ | ❓ | ❓ | | Authority to Operate or FedRAMP| ✅ | ❓ | ❌ | ❌ | ❌ | ✅ | +| Open source* | 🔄 | ❌ | ❌ | ❌ | ✅ | ❌ | +| Community and Support* | 1 | 3 | 3 | 3 | 3 | 3 | +| Scalability* | 🔄 | ✅ | ✅ | ✅ | ✅ | ❌ | - + * Nice to have ## Pros and Cons of the Options @@ -100,7 +110,7 @@ Sendy is a self-hosted email marketing application that allows users to send new #### Cons -- Campaigns with larged audiences or number of emails take a long time to send and a user cannot use the tool while an email is being sent. Currently, we have 1M subscribers and it takes a long time to send to that many subscribers +- Campaigns with larger audiences or number of emails take a long time to send and a user cannot use the tool while an email is being sent. Currently, we have 1M subscribers and it takes a long time to send to that many subscribers. There are methods that could be done to improve this. - Lacks some advanced features present in other platforms. - It requires technical knowledge for setup and maintenance. - Limited customer support compared to premium services.