Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Java: Add Logger #1422

Merged
merged 38 commits into from
Jul 2, 2024
Merged
Show file tree
Hide file tree
Changes from 35 commits
Commits
Show all changes
38 commits
Select commit Hold shift + click to select a range
fec36b1
Implement Logger for Java client
jonathanl-bq May 7, 2024
24af480
Run spotless
jonathanl-bq May 7, 2024
d3b2f81
Annotate NonNull for Level in public API
jonathanl-bq May 7, 2024
e21f773
Fix build error
jonathanl-bq May 7, 2024
a45ab3a
Merge branch 'main' into java/dev_lotjonat_logging
jonathanl-bq May 7, 2024
604066e
Fix clippy lint
jonathanl-bq May 7, 2024
18509b3
Update logger
jonathanl-bq May 13, 2024
a291ad1
Fix FFI function names.
Yury-Fridlyand May 13, 2024
73fc219
Remove %n from logs
jonathanl-bq May 13, 2024
c998a2c
Fix Logger test
jonathanl-bq May 13, 2024
2c3a1e4
Address Yury's PR comments
jonathanl-bq May 16, 2024
cba7ad2
Update java/src/lib.rs
jonathanl-bq May 16, 2024
a7062cd
Apply suggestions from code review
jonathanl-bq May 16, 2024
3a13ee2
Update docs and import Logger.Level
jonathanl-bq May 16, 2024
6bf8fed
Split out native function definitions to a new resolver
jonathanl-bq May 17, 2024
01e6b09
Remove static loader
jonathanl-bq May 17, 2024
7035243
Run Spotless
jonathanl-bq May 17, 2024
fcb4026
Change references to Rust core to Glide core
jonathanl-bq May 17, 2024
5094a4e
Spotless again
jonathanl-bq May 17, 2024
4b4bb44
Make minor documentation fixes
jonathanl-bq May 17, 2024
405f9a3
Merge pull request #265 from Bit-Quill/java/dev_lotjonat_logging
jonathanl-bq May 17, 2024
19b96cf
Merge branch 'main' into java/integ_lotjonat_logging
jonathanl-bq May 17, 2024
1eccd3c
Fix failing tests
jonathanl-bq May 17, 2024
0cfd92b
Run spotless
jonathanl-bq May 17, 2024
8c42435
Address PR comments
jonathanl-bq Jun 12, 2024
6c9b7ae
Apply Spotless
jonathanl-bq Jun 12, 2024
23c9957
Minor documentation fixes
jonathanl-bq Jun 12, 2024
b851598
Don't log when DISABLED log level is passed to log method
jonathanl-bq Jun 28, 2024
c9533fa
Resolve merge conflict and add panic handling for logger FFI code
jonathanl-bq Jul 1, 2024
593702e
Fix build errors and handle errors in FFI layer
jonathanl-bq Jul 1, 2024
9e75012
Make logger messages lazily evaluated
jonathanl-bq Jul 1, 2024
cc978ab
Resolve merge conflict
jonathanl-bq Jul 1, 2024
16aaeb0
Run Spotless
jonathanl-bq Jul 1, 2024
fea98cd
Add overload for log method
jonathanl-bq Jul 1, 2024
ed7fec6
Address Logger TODOs in MessageHandler
jonathanl-bq Jul 1, 2024
1ce4d60
Update java/client/src/main/java/glide/connectors/handlers/MessageHan…
jonathanl-bq Jul 1, 2024
fb3b75b
Use suppliers for logging in MessageHandler
jonathanl-bq Jul 1, 2024
d48f4fb
Address PR comments
jonathanl-bq Jul 2, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
219 changes: 219 additions & 0 deletions java/client/src/main/java/glide/api/logging/Logger.java
Original file line number Diff line number Diff line change
@@ -0,0 +1,219 @@
/** Copyright Valkey GLIDE Project Contributors - SPDX Identifier: Apache-2.0 */
package glide.api.logging;

import static glide.ffi.resolvers.LoggerResolver.initInternal;
import static glide.ffi.resolvers.LoggerResolver.logInternal;

import java.util.function.Supplier;
import lombok.Getter;
import lombok.NonNull;

/**
* A singleton class that allows logging which is consistent with logs from the internal rust core.
* The logger can be set up in 2 ways -
*
* <ol>
* <li>By calling <code>Logger.init</code>, which configures the logger only if it wasn't
* previously configured.
* <li>By calling <code>Logger.setLoggerConfig</code>, which replaces the existing configuration,
* and means that new logs will not be saved with the logs that were sent before the call.
* </ol>
*
* If <code>setLoggerConfig</code> wasn't called, the first log attempt will initialize a new logger
* with default configuration decided by Glide core.
*/
public final class Logger {
@Getter
public enum Level {
DISABLED(-2),
DEFAULT(-1),
ERROR(0),
WARN(1),
INFO(2),
DEBUG(3),
TRACE(4);

private final int level;

Level(int level) {
this.level = level;
}

public static Level fromInt(int i) {
switch (i) {
case 0:
return ERROR;
case 1:
return WARN;
case 2:
return INFO;
case 3:
return DEBUG;
case 4:
return TRACE;
default:
return DEFAULT;
}
}
}

@Getter private static Level loggerLevel;

private static void initLogger(@NonNull Level level, String fileName) {
if (level == Level.DISABLED) {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since we dont have DISABLED option in node and python - can you please open another PR that adds this option to the other wrappers too?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've started work on this. It's not ready yet and probably won't be in until post-GA, but there's a draft PR up here: Bit-Quill#399

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

DISABLED option was added to Java side for testing, since we don't want to log when we have mocks. There's other ways to do it (mocking static objects is annoying, but possible), but this is the best way.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jonathanl-bq adding it to redis-rs isn't urgent, you can open an issue and we'll do it post GA

loggerLevel = level;
return;
}
loggerLevel = Level.fromInt(initInternal(level.getLevel(), fileName));
}

/**
* Initialize a logger if it wasn't initialized before - this method is meant to be used when
* there is no intention to replace an existing logger. The logger will filter all logs with a
* level lower than the given level. If given a <code>fileName</code> argument, will write the
* logs to files postfixed with <code>fileName</code>. If <code>fileName</code> isn't provided,
* the logs will be written to the console.
*
* @param level Set the logger level to one of <code>
* [DISABLED, DEFAULT, ERROR, WARN, INFO, DEBUG, TRACE]
* </code>. If log level isn't provided, the logger will be configured with default
* configuration decided by Glide core.
* @param fileName If provided, the target of the logs will be the file mentioned. Otherwise, logs
* will be printed to the console.
*/
public static void init(@NonNull Level level, String fileName) {
if (loggerLevel == null) {
initLogger(level, fileName);
}
}

/**
* Initialize a logger if it wasn't initialized before - this method is meant to be used when
* there is no intention to replace an existing logger. The logger will filter all logs with a
* level lower than the default level decided by Glide core. Given a <code>fileName</code>
* argument, will write the logs to files postfixed with <code>fileName</code>.
*
* @param fileName The target of the logs will be the file mentioned.
*/
public static void init(@NonNull String fileName) {
init(Level.DEFAULT, fileName);
}

/**
* Initialize a logger if it wasn't initialized before - this method is meant to be used when
* there is no intention to replace an existing logger. The logger will filter all logs with a
* level lower than the default level decided by Glide core. The logs will be written to stdout.
*/
public static void init() {
init(Level.DEFAULT, null);
}

/**
* Initialize a logger if it wasn't initialized before - this method is meant to be used when
* there is no intention to replace an existing logger. The logger will filter all logs with a
* level lower than the given level. The logs will be written to stdout.
*
* @param level Set the logger level to one of <code>[DEFAULT, ERROR, WARN, INFO, DEBUG, TRACE]
jonathanl-bq marked this conversation as resolved.
Show resolved Hide resolved
* </code>. If log level isn't provided, the logger will be configured with default
* configuration decided by Glide core.
*/
public static void init(@NonNull Level level) {
init(level, null);
}

/**
* Logs the provided message if the provided log level is lower than the logger level. This
* overload takes a <code>Supplier</code> to lazily construct the message.
*
* @param level The log level of the provided message.
* @param logIdentifier The log identifier should give the log a context.
* @param messageSupplier The <code>Supplier</code> of the message to log.
*/
public static void log(
@NonNull Level level,
@NonNull String logIdentifier,
@NonNull Supplier<String> messageSupplier) {
if (loggerLevel == null) {
initLogger(Level.DEFAULT, null);
}

if (level == Level.DISABLED) {
return;
}

if (!(level.getLevel() <= loggerLevel.getLevel())) {
return;
}
logInternal(level.getLevel(), logIdentifier, messageSupplier.get());
}

/**
* Logs the provided message if the provided log level is lower than the logger level.
*
* @param level The log level of the provided message.
* @param logIdentifier The log identifier should give the log a context.
* @param message The message to log.
*/
public static void log(
acarbonetto marked this conversation as resolved.
Show resolved Hide resolved
acarbonetto marked this conversation as resolved.
Show resolved Hide resolved
@NonNull Level level, @NonNull String logIdentifier, @NonNull String message) {
if (loggerLevel == null) {
initLogger(Level.DEFAULT, null);
}

if (level == Level.DISABLED) {
return;
}

if (!(level.getLevel() <= loggerLevel.getLevel())) {
return;
}
logInternal(level.getLevel(), logIdentifier, message);
}

/**
* Creates a new logger instance and configure it with the provided log level and file name.
*
* @param level Set the logger level to one of <code>
* [DISABLED, DEFAULT, ERROR, WARN, INFO, DEBUG, TRACE]
* </code>. If log level isn't provided, the logger will be configured with default
* configuration decided by Glide core.
* @param fileName If provided, the target of the logs will be the file mentioned. Otherwise, logs
* will be printed to stdout.
*/
public static void setLoggerConfig(@NonNull Level level, String fileName) {
initLogger(level, fileName);
}

/**
* Creates a new logger instance and configure it with the provided log level. The logs will be
* written to stdout.
*
* @param level Set the logger level to one of <code>
* [DISABLED, DEFAULT, ERROR, WARN, INFO, DEBUG, TRACE]
* </code>. If log level isn't provided, the logger will be configured with default
* configuration decided by Glide core.
*/
public static void setLoggerConfig(@NonNull Level level) {
setLoggerConfig(level, null);
}

/**
* Creates a new logger instance and configure it with the provided file name and default log
* level. The logger will filter all logs with a level lower than the default level decided by the
* Glide core.
*
* @param fileName If provided, the target of the logs will be the file mentioned. Otherwise, logs
* will be printed to stdout.
*/
public static void setLoggerConfig(String fileName) {
setLoggerConfig(Level.DEFAULT, fileName);
}

/**
* Creates a new logger instance. The logger will filter all logs with a level lower than the
* default level decided by Glide core. The logs will be written to stdout.
*/
public static void setLoggerConfig() {
setLoggerConfig(Level.DEFAULT, null);
}
}
Original file line number Diff line number Diff line change
@@ -1,6 +1,9 @@
/** Copyright Valkey GLIDE Project Contributors - SPDX Identifier: Apache-2.0 */
package glide.connectors.handlers;

import static glide.api.logging.Logger.Level.ERROR;

import glide.api.logging.Logger;
import glide.api.models.exceptions.ClosingException;
import glide.api.models.exceptions.ConnectionException;
import glide.api.models.exceptions.ExecAbortException;
Expand Down Expand Up @@ -115,11 +118,15 @@ public void completeRequest(Response response) {
}
future.completeAsync(() -> response);
} else {
// TODO: log an error thru logger.
// probably a response was received after shutdown or `registerRequest` call was missing
System.err.printf(
"Received a response for not registered callback id %d, request error = %s%n",
callbackId, response.getRequestError());
Logger.log(
ERROR,
"callback dispatcher",
() ->
"Received a response for not registered callback id "
+ callbackId
+ ", request error = "
+ response.getRequestError());
distributeClosingException("Client is in an erroneous state and should close");
}
}
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
/** Copyright Valkey GLIDE Project Contributors - SPDX Identifier: Apache-2.0 */
package glide.connectors.handlers;

import glide.api.logging.Logger;
import glide.api.models.PubSubMessage;
import glide.api.models.configuration.BaseSubscriptionConfiguration.MessageCallback;
import glide.api.models.exceptions.RedisException;
Expand Down Expand Up @@ -39,8 +40,10 @@ public class MessageHandler {
public void handle(Response response) {
Object data = responseResolver.apply(response);
if (!(data instanceof Map)) {
// TODO log thru logger https://github.com/aws/glide-for-redis/pull/1422
System.err.println("Received invalid push: empty or in incorrect format.");
Logger.log(
Logger.Level.WARN,
"invalid push",
"Received invalid push: empty or in incorrect format.");
throw new RedisException("Received invalid push: empty or in incorrect format.");
}
@SuppressWarnings("unchecked")
Expand All @@ -50,11 +53,10 @@ public void handle(Response response) {

switch (pushType) {
case Disconnection:
// TODO log thru logger https://github.com/aws/glide-for-redis/pull/1422
// ClientLogger.log(
// LogLevel.WARN,
// "disconnect notification",
// "Transport disconnected, messages might be lost",
Logger.log(
Logger.Level.WARN,
"disconnect notification",
"Transport disconnected, messages might be lost");
break;
case PMessage:
handle(new PubSubMessage((String) values[2], (String) values[1], (String) values[0]));
Expand All @@ -70,21 +72,21 @@ public void handle(Response response) {
case PUnsubscribe:
case SUnsubscribe:
// ignore for now
// TODO log thru logger https://github.com/aws/glide-for-redis/pull/1422
System.out.printf(
"Received push notification of type '%s': %s\n",
pushType,
Arrays.stream(values)
.map(v -> v instanceof Number ? v.toString() : String.format("'%s'", v))
.collect(Collectors.joining(" ")));
Logger.log(
Logger.Level.INFO,
"SUnsubscribe notification",
String.format(
jonathanl-bq marked this conversation as resolved.
Show resolved Hide resolved
"Received push notification of type '%s': %s\n",
jonathanl-bq marked this conversation as resolved.
Show resolved Hide resolved
pushType,
Arrays.stream(values)
.map(v -> v instanceof Number ? v.toString() : String.format("'%s'", v))
.collect(Collectors.joining(" "))));
break;
default:
// TODO log thru logger https://github.com/aws/glide-for-redis/pull/1422
System.err.printf("Received push with unsupported type: %s.\n", pushType);
// ClientLogger.log(
// LogLevel.WARN,
// "unknown notification",
// f"Unknown notification message: '{message_kind}'",
Logger.log(
Logger.Level.WARN,
"unknown notification",
String.format("Unknown notification message: '%s'", pushType));
jonathanl-bq marked this conversation as resolved.
Show resolved Hide resolved
}
}

Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,9 @@
/** Copyright Valkey GLIDE Project Contributors - SPDX Identifier: Apache-2.0 */
package glide.connectors.handlers;

import static glide.api.logging.Logger.Level.ERROR;

import glide.api.logging.Logger;
import io.netty.channel.ChannelHandlerContext;
import io.netty.channel.ChannelInboundHandlerAdapter;
import lombok.NonNull;
Expand Down Expand Up @@ -29,9 +32,7 @@ public void channelRead(@NonNull ChannelHandlerContext ctx, @NonNull Object msg)
/** Handles uncaught exceptions from {@link #channelRead(ChannelHandlerContext, Object)}. */
@Override
public void exceptionCaught(ChannelHandlerContext ctx, Throwable cause) throws Exception {
// TODO: log thru logger
System.out.printf("=== exceptionCaught %s %s %n", ctx, cause);
cause.printStackTrace();
Logger.log(ERROR, "read handler", () -> "=== exceptionCaught " + ctx + " " + cause);

callbackDispatcher.distributeClosingException(
"An unhandled error while reading from UDS channel: " + cause);
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
/** Copyright Valkey GLIDE Project Contributors - SPDX Identifier: Apache-2.0 */
package glide.ffi.resolvers;

public class LoggerResolver {
// TODO: consider lazy loading the glide_rs library
static {
NativeUtils.loadGlideLib();
}

public static native int initInternal(int level, String fileName);

public static native void logInternal(int level, String logIdentifier, String message);
}
1 change: 1 addition & 0 deletions java/client/src/main/java/module-info.java
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
module glide.api {
exports glide.api;
exports glide.api.commands;
exports glide.api.logging;
exports glide.api.models;
exports glide.api.models.commands;
exports glide.api.models.commands.bitmap;
Expand Down
Loading
Loading