Skip to content
This repository has been archived by the owner on Nov 22, 2024. It is now read-only.

Operator on Fabric8 actions #994

Merged
merged 105 commits into from
Mar 23, 2021
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
105 commits
Select commit Hold shift + click to select a range
44ce47d
blueprint ported to tools
andreaTP Feb 24, 2021
667fb1c
[WIP] partial operator actions
andreaTP Feb 24, 2021
5a196f5
a little more
andreaTP Feb 25, 2021
3856bf0
Cloudflow config to its own module
andreaTP Feb 26, 2021
c9742e7
more fixes to the tests
andreaTP Feb 26, 2021
643e60a
more
andreaTP Feb 26, 2021
ca44cb2
most of pod configuration
andreaTP Feb 26, 2021
12f50a7
more
andreaTP Feb 26, 2021
d7cd5f7
more
andreaTP Feb 26, 2021
4c5ef97
more and more
andreaTP Feb 26, 2021
ab40d02
topic actions
andreaTP Mar 1, 2021
0a17ecc
event actions
andreaTP Mar 1, 2021
17b170b
endpoint action
andreaTP Mar 1, 2021
ac5605a
initial AkkaRunner wip
andreaTP Mar 1, 2021
3d6e165
Akka Runner is ported
andreaTP Mar 1, 2021
a1652e0
minor
andreaTP Mar 2, 2021
921f05c
more
andreaTP Mar 2, 2021
23ffb04
compiling operator actions
andreaTP Mar 2, 2021
adf9575
downwardapi
andreaTP Mar 2, 2021
86a6a5f
finally operator
andreaTP Mar 2, 2021
db4c677
operator
andreaTP Mar 2, 2021
bf4bde4
22 to go
andreaTP Mar 2, 2021
049739b
compiling
andreaTP Mar 3, 2021
53996d2
crd creation
andreaTP Mar 3, 2021
ec70da7
more
andreaTP Mar 3, 2021
036ce86
working
andreaTP Mar 3, 2021
59fc5ab
more
andreaTP Mar 4, 2021
9a73c08
carl working
andreaTP Mar 4, 2021
f04657a
more fixes
andreaTP Mar 4, 2021
297d7b3
half flink ...
andreaTP Mar 5, 2021
fba0917
flink runner
andreaTP Mar 8, 2021
fba36e7
more
andreaTP Mar 8, 2021
1eb7a66
IT TEST PASSING - BASELINE
andreaTP Mar 8, 2021
91527c9
more
andreaTP Mar 8, 2021
b719563
getting rid of CloudflowApplication
andreaTP Mar 8, 2021
3a9f821
detach status computation from model
andreaTP Mar 9, 2021
4dce1c7
working external cloudflow status
andreaTP Mar 9, 2021
06614eb
cleanup
andreaTP Mar 9, 2021
4c83fd0
type back the events
andreaTP Mar 9, 2021
16ba991
renamings
andreaTP Mar 9, 2021
100f12e
re-use the blueprint
andreaTP Mar 9, 2021
8322e83
comment
andreaTP Mar 9, 2021
42f7822
docker-image
andreaTP Mar 10, 2021
9b3c005
docker publish and sbt workflow
andreaTP Mar 10, 2021
3162062
various ...
andreaTP Mar 10, 2021
7b3d8be
fix the crd
andreaTP Mar 10, 2021
a578d07
blueprint to Cr convertion
andreaTP Mar 10, 2021
b1beb24
deployment context
andreaTP Mar 10, 2021
1a29eaa
resource names spec ported
andreaTP Mar 10, 2021
71f6469
topics action spec
andreaTP Mar 10, 2021
e3f33ed
event action spec
andreaTP Mar 10, 2021
cfd49e8
endpoint action
andreaTP Mar 10, 2021
c7c8903
more
andreaTP Mar 10, 2021
a86f56c
cloudflow application spec
andreaTP Mar 11, 2021
16a6307
pods configs spec
andreaTP Mar 11, 2021
27e8740
akka runner spec
andreaTP Mar 11, 2021
ac65607
half runner actions spec
andreaTP Mar 11, 2021
f0bc2e8
runner action spec
andreaTP Mar 12, 2021
4bf823f
flink runner spec
andreaTP Mar 12, 2021
0da0492
fix volumes config validation and spark runner spec
andreaTP Mar 12, 2021
49f38a1
optimize imports
andreaTP Mar 12, 2021
21b4b2c
WIP
andreaTP Mar 12, 2021
1484ad9
more debug
andreaTP Mar 12, 2021
6829000
more
andreaTP Mar 12, 2021
e564116
fixes for integration tests
andreaTP Mar 12, 2021
80e49aa
no retries
andreaTP Mar 12, 2021
ed5db68
LAST COMMIT WITH PROVIDED ACTION
andreaTP Mar 12, 2021
d12e167
delete action extensions
andreaTP Mar 12, 2021
dfdc27c
disable scalafmtcheck for blueprint
andreaTP Mar 12, 2021
d19c698
published kube actions and fix the tests
andreaTP Mar 12, 2021
ba657e8
remove the skuber operator
andreaTP Mar 12, 2021
f4c1612
the glorious return of ActionExtension
andreaTP Mar 12, 2021
b468eee
more
andreaTP Mar 12, 2021
909b57a
scalafmt sbt
andreaTP Mar 12, 2021
c680168
cleanup
andreaTP Mar 12, 2021
fe7b8ee
abstract methods in runner
andreaTP Mar 15, 2021
114996b
re-generate cli native config
andreaTP Mar 15, 2021
d2dc403
cleanup
andreaTP Mar 15, 2021
b2065f1
softer create of resources ...
andreaTP Mar 15, 2021
082e0ff
try to improve
andreaTP Mar 15, 2021
c24d49b
more
andreaTP Mar 15, 2021
f53dbd5
check
andreaTP Mar 15, 2021
88d3c87
restore akka cerateOrReplace
andreaTP Mar 15, 2021
ccf763e
more
andreaTP Mar 15, 2021
be72b83
again
andreaTP Mar 15, 2021
007ad3a
more
andreaTP Mar 15, 2021
5fc7803
wrangling patches for Spark
andreaTP Mar 16, 2021
eb3eda4
more
andreaTP Mar 16, 2021
95a1b7f
more stability fixes
andreaTP Mar 16, 2021
dd19bdf
more debug
andreaTP Mar 16, 2021
90b2923
more
andreaTP Mar 16, 2021
bbb044e
try again
andreaTP Mar 16, 2021
dbdc992
retry again to make it working
andreaTP Mar 16, 2021
ff82705
more
andreaTP Mar 17, 2021
5b4928f
regenerated graal vm config
andreaTP Mar 17, 2021
54569a7
header
andreaTP Mar 17, 2021
51ad3f9
more
andreaTP Mar 17, 2021
1c2c0be
review
andreaTP Mar 18, 2021
f4839ed
review
andreaTP Mar 18, 2021
973023d
minor
andreaTP Mar 18, 2021
59e91ea
review
andreaTP Mar 22, 2021
e775c8f
more
andreaTP Mar 22, 2021
4820920
review
andreaTP Mar 22, 2021
1930ab5
akka arg
andreaTP Mar 22, 2021
455963c
fixes
andreaTP Mar 23, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
124 changes: 5 additions & 119 deletions core/build.sbt
Original file line number Diff line number Diff line change
Expand Up @@ -101,9 +101,7 @@ lazy val root =
localRunner,
runner,
blueprint,
plugin,
operator,
operatorActions
plugin
)

lazy val streamlets =
Expand Down Expand Up @@ -357,7 +355,8 @@ lazy val blueprint =
cloudflowModule("cloudflow-blueprint")
.enablePlugins(BuildInfoPlugin, ScalafmtPlugin)
.settings(
scalafmtOnCompile := true,
scalafmtOnCompile := false,
Compile / scalafmtCheck := true,
libraryDependencies ++= Vector(
Avro,
Config,
Expand All @@ -372,11 +371,9 @@ lazy val blueprint =
publishArtifact in Test := true
)
.settings(
Compile / unmanagedSourceDirectories += (ThisProject / baseDirectory).value / ".." / ".." / "tools" / "cloudflow-blueprint" / "src" / "main" / "scala",
crossScalaVersions := Vector(Version.Scala212, Version.Scala213),
buildInfoKeys := Seq[BuildInfoKey](
name,
version
),
buildInfoKeys := Seq[BuildInfoKey](name, version),
buildInfoPackage := "cloudflow.blueprint"
)

Expand Down Expand Up @@ -453,117 +450,6 @@ lazy val localRunner =
crossScalaVersions := Vector(Version.Scala212, Version.Scala213),
scalafmtOnCompile := true
)
lazy val operatorActions =
cloudflowModule("cloudflow-operator-actions")
.enablePlugins(
ScalafmtPlugin
)
.dependsOn(blueprint % "compile->compile;test->test")
.settings(
crossScalaVersions := Vector(Version.Scala212, Version.Scala213),
scalafmtOnCompile := true,
libraryDependencies ++= Vector(
AkkaSlf4j,
Ficus,
LogbackClassic,
LogbackCore,
Skuber,
ScalaTest,
"org.apache.kafka" % "kafka-clients" % Version.KafkaClients,
ScalaCheck % "test"
)
)

lazy val operator =
cloudflowModule("cloudflow-operator")
.enablePlugins(
sbtdocker.DockerPlugin,
JavaAppPackaging,
BuildInfoPlugin,
ScalafmtPlugin
)
.dependsOn(blueprint % "compile->compile;test->test")
.dependsOn(operatorActions)
.settings(
scalafmtOnCompile := true,
libraryDependencies ++= Vector(
AkkaSlf4j,
AkkaStream,
Ficus,
Skuber,
ScalaTest,
"org.apache.kafka" % "kafka-clients" % Version.KafkaClients,
AkkaStreamTestkit % "test",
ScalaCheck % "test",
Avro4sJson % "test"
)
)
.settings(
skip in publish := scalaVersion.value == Version.Scala212,
crossScalaVersions := Vector(Version.Scala212, Version.Scala213),
organization := "com.lightbend.cloudflow",
skip in publish := true,
mainClass in Compile := Some("cloudflow.operator.Main"),
publishArtifact in (Compile, packageDoc) := false,
publishArtifact in (Compile, packageSrc) := false,
buildOptions in docker := BuildOptions(
cache = true,
removeIntermediateContainers = BuildOptions.Remove.OnSuccess,
pullBaseImage = BuildOptions.Pull.IfMissing
// TODO: "Always" won't work unless you have used `docker login` with
// your own service/user account. We should move to use some
// way to call `gcloud docker --` instead.
// pullBaseImage = BuildOptions.Pull.Always
),
imageNames in docker := Seq(
ImageName(
registry = None,
namespace = Some("lightbend"),
repository = "cloudflow-operator",
tag = Some((ThisBuild / version).value)
)
),
dockerfile in docker := {
val appDir: File = stage.value
val targetDir = "/app"

new Dockerfile {
from("adoptopenjdk/openjdk8:alpine")
entryPoint(s"$targetDir/bin/${executableScriptName.value}")
copy(appDir, targetDir, chown = "daemon:daemon")
addInstruction(Instructions.Run("apk add bash; \\"))
}
},
Test / fork := true,
scalacOptions ++= Seq(
"-encoding",
"UTF-8",
"-target:jvm-1.8",
"-Xlog-reflective-calls",
"-Xlint",
"-Ywarn-unused",
"-deprecation",
"-feature",
"-language:_",
"-unchecked"
),
scalacOptions in (Compile, console) := (scalacOptions in (Global)).value.filter(_ == "-Ywarn-unused-import")
)
.settings(
buildInfoKeys := Seq[BuildInfoKey](
name,
version,
scalaVersion,
sbtVersion,
BuildInfoKey.action("buildTime") {
java.time.Instant.now().toString
},
BuildInfoKey.action("buildUser") {
sys.props.getOrElse("user.name", "unknown")
}
),
buildInfoPackage := "cloudflow.operator"
)

def cloudflowModule(moduleID: String): Project =
Project(id = moduleID, base = file(moduleID))
Expand Down
Empty file.
Loading