Skip to content
View njhill's full-sized avatar
  • Red Hat
  • San Jose, California

Organizations

@netty @kserve @vllm-project

Block or report njhill

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Pinned Loading

  1. vllm-project/vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 34.6k 5.3k

  2. IBM/text-generation-inference Public

    IBM development fork of https://github.com/huggingface/text-generation-inference

    Python 58 31

  3. IBM/etcd-java Public

    Alternative etcd3 java client

    Java 157 45

  4. kserve/modelmesh Public

    Distributed Model Serving Framework

    Java 156 68

  5. netty/netty Public

    Netty project - an event-driven asynchronous network application framework

    Java 33.7k 16k

  6. IBM/kv-utils Public

    Abstracted helper classes providing consistent key-value store functionality, with zookeeper and etcd3 implementations

    Java 5 2

928 contributions in the last year

Contribution Graph
Day of Week January February March April May June July August September October November December January
Sunday
Monday
Tuesday
Wednesday
Thursday
Friday
Saturday
Less
No contributions.
Low contributions.
Medium-low contributions.
Medium-high contributions.
High contributions.
More

Activity overview

Contributed to vllm-project/vllm, IBM/vllm, opendatahub-io/vllm-gaudi and 18 other repositories
Loading A graph representing njhill's contributions from January 21, 2024 to January 24, 2025. The contributions are 48% commits, 37% code review, 15% pull requests, 0% issues. 37% Code review   Issues 15% Pull requests 48% Commits

Contribution activity

January 2025

Created 3 commits in 1 repository

Created a pull request in vllm-project/vllm that received 18 comments

[Frontend][V1] Online serving performance improvements

These help in particular with TTFT, ITL variance, and overall throughput. Break up output processing (detokenization) to avoid blocking the event …

+101 −45 lines changed 18 comments
Opened 2 other pull requests in 1 repository
vllm-project/vllm 2 merged
Reviewed 7 pull requests in 1 repository
vllm-project/vllm 7 pull requests

Created an issue in vllm-project/production-stack that received 3 comments

With the session-based routing, what happens when a pod goes away?

Sorry if I missed something but from a quick look through the code, it looks like all subsequent requests belonging to sessions assigned to that po…

3 comments
Loading

Seeing something unexpected? Take a look at the GitHub profile guide.