![]() ![]() It is now possible to connect to Kafka, HDFS, and Hive Metastore by using Kerberos authentication. We’ve also consolidated Dependencies and Interpreter Settings into a single window, making it easier to find the necessary settings. We’ve added code completion for PySpark paragraphs in Zeppelin, which completes column names by providing a list of the inferred columns from the DataFrame. In this release, we have added options to extract both selected Scala code and code from paragraphs. If you are working with a Zeppelin notebook in your IDE, you can extract Spark job code into a Scala file to continue working on it in an IDE project. Improvements to Apache Zeppelin integration You can open the Hive Metastore or its particular catalogs, databases, and tables in a separate tab of the editor. ![]() Now the plugin supports both Hive 3 and Hive 2, allowing users to preview and understand their data within their IDE. The new contextual search feature lets you quickly locate a specific bucket in your cloud storage by typing relevant keywords.If you use object or bucket tagging to categorize storage, you can now modify and view them without leaving your editor window.You can now view and manage versions of the bucket objects right in your IDE.We have aligned our feature set between all supported remote file storages (such as Amazon S3, Google Cloud Storage, and Microsoft Azure Blob Storage). We also enabled a connection to Schema Registry via a secure SSH tunnel to help you consume and produce messages from your local machine. With this latest update, you can explore Kafka topics serialized in Avro or Protobuf directly from the IDE. The Schema Registry defines the data structure and helps keep your Kafka applications synchronized with data changes. ![]() In response to numerous requests, we have integrated the Kafka Schema Registry connection into the Big Data Tools plugin 2023.1. Read on to learn about the most important changes in the Big Data Tools plugin or try it right now by installing it to IntelliJ IDEA Ultimate, P圜harm Professional, DataSpell, or DataGrip 2023.1. In this release, we’ve added integration with Kafka Schema Registry, Kerberos authentication, and extended support for all cloud storages in Big Data Tools. Our latest release includes several new features and improvements based on feedback from our users. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |